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ABSTRACT 


Two  distributed  routing  procedures  based  upon  the  Yen 
shortest  path  algorithm  are  developed  for  application  in  a 
packet-snitched  communications  network.  The  algorithm  uses 
a  unique  aetbod  in  calculating  shortest  paths  based  upon  the 
time  of  arrival  of  update  messages.  The  first  routing 
procedure  uses  a  proposed  "combination"  link  weight  function 
having  parameters  involving  both  current  link  queue  size  and 
recent  history  cf  link  utilization.  Performance  of  this 
procedure  is  analyzed  under  a  variety  cf  network  conditions 
using  computer  simulation.  A  comparison  study  is  done  with 
both  a  least  hop  routing  protocol  and  a  multiple  path  static 
routing  protocol.  The  second  routing  procedure  has  a  hier¬ 
archical  structure  which  offers  substantial  reductions  in 
routing  traffic  and  memory  requirements  over  the  first 
version  when  implemented  in  large  networks.  The  major 
conclusion  is  that  these  routing  procedures  exhibit  robust 
operating  characteristics  which  are  almost  optimal  in  simple 
situatiors. 
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I-  IN1BODOCTIOH 


In  describing  the  activities  of  a  military  recruit 
during  the  first  phase  of  basic  training,  the  phrase  "hurry 
up  and  wait"  is  often  used.  An  illustration  of  this  prac¬ 
tice  is  the  double-time  march  to  the  barber,  only  to  wait 
hours  in  line  for  a  thirty  second  haircut.  The  recruit 
probably  feels  there  must  be  a  better  way  to  do  this. 
Similar  feelings  may  also  cccur  when  stopped  in  freeway 
traffic  or  while  trying  to  get  an  open  telephone  line  tc  the 
grandparents  on  Christmas. 

Although  these  problems  appear  to  be  taken  from 
distinctly  different  situations,  they  possess  a  fundamental 
property  in  common;  they  all  relate  to  processes  involving 
the  flow  cf  some  commodity  through  a  channel  or  network  of 
channels.  In  fact,  a  wide  variety  of  large  physical  systems 
exhibit  all  the  characteristics  which  mathematicians  asso¬ 
ciate  with  networks.  The  freeway  and  telephone  systems  may 
have  nothing  in  common  by  way  cf  installations  and  equipment 
yet  bcth  have  similar  network  representations.  Both  have 
junctions  cr  nodes  which  are  connected  by  channels  or  links. 
In  the  links  of  these  cetworks  there  is  a  flow  (cars  in  one 


and  conversations  in  the  other)  and  in  both  cases  links  can 
he  used  to  fora  paths  between  nodes  which  are  not  directly 
connected. 

The  need  for  solutions  to  the  problems  associated  with 
the  flew  cf  commodities  within  networks  has  caused  an 
increase  of  activity  in  branches  of  mathematics  involving 
queueing#  graph  and  network  theory.  Ford  and  Fulkerson 
(Bef.  1 ]  in  the  late  1950‘s  developed  methods  to  solve  a 
railway  transportation  problem  known  as  the  Hitchcock 
problem.  Their  solution  was  the  design  of  network  flows  so 
as  tc  minimize  the  ccsts  related  to  use  of  the  network  while 
still  satisfying  certain  flow  requirements  which  existed  at 
some  nodes.  The  result  of  their  work  was  a  more  efficient 
and  cost  effective  transportation  system. 

In  the  events  leading  to  the  solution  of  the  Hitchccck 
problem,  the  importance  of  the  commodity  carried  by  the 
network  helped  provide  the  impetus  for  rigorous  research. 
In  a  similar  fashion,  the  current  focus  of  attention  is  on 
an  item  of  ever  increasing  importance:  the  commodity  of 

information.  Finding  increasingly  efficient  methods  to 
"transport”  information  through  communications  networks  has 
indeed  become  a  major  goal  to  a  variety  of  research  efforts. 
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This  thesis  is  part  of  an  ongoing  effort  being  conducted 
at  the  Naval  Postgraduate  School  with  communications 


networks,  and  in  particular,  the  packet-switched  network. 
The  purpose  of  this  work  is  the  application  and  analysis  of 
a  distrituted  routing  procedure  which  guides  the  commodity 
of  information  through  the  network.  Chapters  I  and  II 
provide  background  information  concerning  packet-switched 
networks  and  the  function  of  routing  procedures.  The  third 
chapter  introduces  the  distributed  routing  algorithm  which 
was  modified  and  adapted  for  use  within  such  a  network.  The 
remainder  of  the  work  deals  with  the  thorough  test  and  eval¬ 
uation  of  the  routing  protocol  using  a  computer  simulation 
model. 

1.  CCHHOIICATIONS  NETSOBKS 

As  with  all  networks,  communications  networks  can  be 
represented  as  being  composed  of  the  three  basic  elements; 
nodes,  links,  and  flow  commodities.  The  commodity  has 
already  teen  seen  to  be  information  which  must  he  passed 
through  the  network.  The  nodes  represent  communications 
centers  which  can  receive,  store,  and  transmit  information. 


Nodes  are  connected  by  means  of  communication  channels  which 
are  the  links  with  other  nodes.  A  detailed  description  of 


these  elements  is  purposely  not  given  since  their  configura¬ 
tion  say  vary  depending  upon  the  type  of  network.  However, 
their  basic  functions  remain  the  same  in  all  networks. 

Due  to  the  many  different  types  of  communications 
networks  which  exist,  a  variety  of  methods  for  categoriza¬ 
tion  have  been  developed.  &  basic  classification  method  is 
based  upon  the  number  of  communications  channels  present  in 
the  network.  When  cnly  a  single  link  exists  which  must  be 
shared  by  all  nodes,  the  network  is  termed  "broadcast”. 
However  if  multiple  links  exist,  such  that  all  nodes  are  not 
in  direct  communications  with  each  other,  then  the  network 
is  "point-to-point".  In  this  case  nodes  not  directly 
connected  must  communicate  via  other  nodes. 

Networks  are  also  described  by  their  topology  using 
terminology  common  tc  graph  theory.  The  arrangement  of 
nodes  and  links,  for  example,  may  form  a  star,  tree  or  loop. 
Each  configuration  has  certain  characteristics,  with  the 
selection  of  a  particular  topology  being  a  very  important 
design  consideration.  Often  in  reference  to  communications 
networks,  the  words  centralized,  decentralized  and  distrib¬ 
uted  will  also  be  used  to  give  the  general  network  configu- 


Figure  1.1  Network  Topologies 


lend  themselves  to  particular  types  of  network  control  which 
often  use  the  saie  terminology.  Control  of  the  network  may 
te  the  responsibility  of  a  single  node  (centralized) ,  a 
portion-  cf  the  nodes  (decentralized)  ,  or  all  of  the  nodes 
(distributed).  Confusion  can  occur  when  it  is  net  clear 
whether  the  network  being  described  is  distributed  in  terms 
cf  topology,  control  or  beth.  In  the  next  chapter,  the 
network  control  function  of  routing  is  categorized  in  terms 
of  where  the  algorithm  is  actually  performed. 

Ecint-to-point  networks  can  be  subdivided  into  two  basic 
categories  depending  upon  the  method  us9d  to  pass  informa¬ 
tion.  The  first  technique  called  line-switching  is  analo¬ 
gous  to  the  telephone  (voice)  network.  Here  calls  and 
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message  renting  are  set  up  prior  to  the  beginning  of  the 
message  transmission .  Once  a  complete  circuit  or  route  is 
established,  the  message  is  ready  for  transmission.  The 
second  method  is  called  packet-switching  and  is  discussed  in 
detail  in  the  next  section. 


E.  PiC  HIT- SWITCHED  HETWOBKS 

The  ccncept  cf  packet- switching  arose  from  the  need  to 
provide  a  "better  way"  to  exchange  information  between 
computers  than  was  possible  with  the  line-switching  techni¬ 
ques  used  in  conventional  telephone  networks.  The  problem 
lay  in  the  basic  difference  between  human  and  computer 
"conversations" .  Computer  communication  is  "bursty",  in 
that  it  consists  of  short  transmissions  of  data  at  high 
rates  followed  by  long  periods  of  silence.  This  is  quite 
unlike  human  conversation  in  which  calls  usually  last  much 
longer  than  the  time  it  takes  to  set  up  the  call  in  the 
switching  center.  In  other  words,  human-to-human  traffic 
requires  long-duraticn  use  of  a  low-bandwidth  charnel, 
whereas  (seme)  computer-t c-ccmputer  traffic  needs  short- 
duration  use  of  a  high-bandwidth  channel. 

The  alternative  switching  str^-egy  of  packet-switching 
removes  tie  requirement  of  having  a  dedicated  physical  path 
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established  in  advance  between  source  and  destination  redes. 
Therefore  the  inefficiency  cf  having  computer  conversations 
which  take  less  time  than  is  required  to  set  up  the  call  is 
eliminated. 

In  a  packet -switched  communications  network,  when  the 
source  nede  has  a  block  of  data  to  send,  that  block  is  first 
divided  into  subunits  which  are  a  fixed  number  of  bits  in 
length.  attached  then  to  each  subunit  is  addressing  and 
control  information  such  that  the  resulting  "packet"  can 
reach  its  destination.  Packet  size  (usually  1000  bits  or 
less)  is  kept  relatively  small  so  that  no  single  user  can 
monopolize  a  link  for  too  long  at  a  time.  The  basic  opera¬ 
tion  cf  packet- switching  can  best  be  described  by  following 
the  movements  of  the  first  packet  as  it  proceeds  through  the 
network. 

at  the  source  node,  a  decision  is  made  as  to  which 
outgoing  link  the  packet  will  be  transmitted.  The  decision 
rule  is  referred  to  as  a  routing  procedure  or  algorithm. 
The  status  cf  the  selected  link  is  then  checked  and  if  that 
link  is  idle,  the  packet  is  transmitted  over  the  link. 
However  if  the  lr.’.k  is  busy,  the  packet  joins  a  gueue;  this 
is  accomplished  physically  fcy  storing  the  packet  in  memory. 
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Hhen  the  packet  reaches  the  head  of  the  queue,  the  packet  is 
transaitted. 

In  arriving  at  the  next  node,  the  addressing  information 
of  the  packet  is  used  to  determine  if  the  destination  has 
fceen  reached.  The  routing  procedure  is  repeated  if  the 
packet  has  not  yet  completed  its  trip.  Eventually,  the 
packet  will  reach  its  destination.  It  is  clear  why  these 
networks  are  often  called  store-and- forward  nets,  since  in 
passing  through  a  node  packets  are  stored,  if  necessary,  and 
then  forwarded  (transmitted)  to  the  next  node  on  the  way  to 
their  destination. 

1 .  Message  Services 

The  remaining  packets  of  the  data  block  can  travel 
through  the  network  using  one  of  two  techniques.  These 
techniques  cr  services  are  usually  selected  depending  upon 
the  nature  cf  the  traffic,  which  may  be  computer  file  trans¬ 
fers,  interactive  terminal  sessions  or  even  digitized  voice 
conversations.  The  first  is  the  pure  packet-switching  or 
datagram  technique,  and  the  second  is  the  packetized  virtual 
circuit  technique. 

Using  datagrams,  each  packet  is  routed  independently 
through  the  network.  The  packets  making  up  a  particular 
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data  tlcck  oould  each  take  different  routes  through  the 
network  and  thus  arrive  at  the  destination  node  out  of 
sequence.  Hence,  a  resequencing  mechanism  is  required  at 
the  destination.  Packets  necessarily  contain  complete 
addressing  informaticr  since  they  move  independently  through 
the  network. 

In  contrast,  a  packetized  virtual  circuit  is  a 
circuit-switching-like  approach.  Information  flew  is  in 
packetized  form  and  virtual  circuits  carry  the  traffic. 
Packets  belonging  to  the  same  data  block  will  travel  the 
same  route  through  the  network.  This  route  (i.e  the 
virtual  circuit)  is  created  in  the  following  manner. 

The  first  packet  of  a  particular  data  block  acts  as 
a  "trailblazer"  which  establishes  the  route  as  it  passes 
through  each  node.  Ncdes  maintain  a  "circuit  table"  so  that 
all  subsequent  packets  will  be  routed  in  the  same  way.  Once 
a  circuit  is  established,  subsequent  packets  need  only 
contain  simple  header  information  which  identifies  them  with 
the  initial  packet.  Connections  can  be  created  with  virtual 
circuits  which  will  remain  until  broken  down  at  the  termina¬ 
tion  cf  the  session. 
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In  comparing  datagrams  and  virtual  circuits  seme 
summarizing  points  are  given: 

1.  Virtual  circuit  packets  are  shorter  than  datagram 
packets  because  of  the  reduced  addressing  information 
regained. 

2.  Datagrams  reguire  nodes  to  possess  a  resequencing 
protocol  for  packets  arriving  out  of  their  original 
order. 

3.  Virtual  circuits  tend  to  route  packets  less  effi¬ 
ciently  than  datagrams.  Subsequent  packets  in  a 
virtual  circuit  may  net  be  taking  the  best  path  if 
network  conditions  change  while  the  circuit  is  in 
operation.  Or  the  other  hand,  datagram  packets  would 
be  routed  according  to  the  current  routing  procedure 
at  each  node  and  thus  their  paths  are  not  constrained 
by  an  outdated  decision. 

2.  ftnplicat ion  with  Voice  Traffic 

Facket-s witching  was  originally  proposed  because  it 
was  recognized  that  computers  were  very  inefficient  users  of 
the  line-switching  techniques  which  had  worked  quite  well 
for  human  speech  in  the  telephone  system.  Rather  than  try 
to  make  a  computer  "speak"  like  a  man  so  that  it  could  use 
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the  telephone,  a  new  switching  technique  was  developed.  The 
success  cf  packet-switching  and  its  obvious  benefits  have 
led  to  research  efforts  in  developing  methods  by  which  voice 
traffic  cculd  be  transmitted  using  this  technique. 

The  difficulty  in  this  implementation  does  not  lie 
in  making  the  voice  packets.  4  number  of  methods  are  used 
which  convert  analog  speech  to  a  digital  waveform.  Data 
rates  as  lew  as  2.4  to  4.8  kbits/sec  have  been  achieved 
using  vocoders  with  linear  predictive  coding.  The  sampled 
voice  data  is  divided  into  discrete  packets  with  packet 
length  corresponding  to  an  interval  of  the  analog  signal. 

The  fundamental  problem  which  plagues  packetized 
voice  networks  relates  to  the  nature  of  speech,  which 
requires  both  high  throughput  and  low  delay,  a  feature  which 
is  net  ccnsistant  with  the  capabilities  of  most  packet 
networks.  In  order  that  the  quality  of  speech  be  preserved, 
voice  traffic  in  a  packet -switched  network  must  maintain 
continuity.  Voice  gaps  caused  by  end-to-end  delays  are 
generally  undesirable.  Traditional  line-switched  networks 
exhibit  fixed  delays  tc  voice  traffic  and  thus  the  relative 
speech  tiling  was  preserved.  However,  the  variable  delays 
due  tc  the  possible  gueueing  cf  voice  packets  can  cause  loss 
in  intelligibility. 
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In  crder  to  achieve  regularity  in  voice  traffic  a 
variety,  cf  schemes  have  already  been  investigated.  The  use 
cf  both  datagrams  and  virtual  circuits  have  been  suggested 
and  the  lerits  cf  each  have  been  cited  by  Gruber  [Bef.  2]. 
Datagrams,,  it  is  pointed  cut,  provide  the  shortest 
end-tc-end  delay  and  thus  voice  continuity  would  be  more 
readily  achieved.  Also,  due  to  the  redundant  nature  of 
speech,  the  effects  of  lost  or  damaged  packets  would  not 
have  the  catastrophic  effect  which  accompanies  similar 
occurrences  in  computer  data  networks.  Virtual  circuits,  on 
the  other  hand,  do  net  have  the  resequencing  delays  associ¬ 
ated  with  datagram  service.  Additionally,  the  shorter 

packet  length  would  cause  less  congestion  than  the  larger 
datagram  packet  caused. 

The  issue  of  how  best  to  implement  voice  traffic  in 
a  packet-switched  network  is  by  no  means  resolved.  The  gcal 
cf  reducing  delay,  however,  continues  to  be  germane  to  all 
packetr switched  networks,  and  in  the  case  of  voice  traffic 
may  he  the  mest  important  issue.  Work  aimed  at  developing 
routing  techniques  which  are  applicable  to  these  networks 
continues  to  be  relevant,  if  not  critical,  to  future 
success. 


C.  1ETH0BK  ABCHITECTOBE 


As  stated  earlier,  this  thesis  involves  the  development 
and  application  of  a  routing  procedure  for  a  packet-switched 
distributed  communications  network.  The  function  of 
selecting  which  outgoing  link  a  packet  will  take  is  one  of 
the  many  operations  that  must  be  performed  in  order  for  the 
network  tc  provide  effective  service  to  its  users.  The 
complexity  of  the  relationships  between  these  functions  can 
make  it  difficult  tc  understand  how  routing  procedures  fit 
into  the  total  network  architecture.  This  task  car.  be 
greatly  simplified  by  using  a  conceptual  model  proposed  by 
the  International  Standards  Organization  (ISO)  for  communi¬ 
cations  networks. 

The  iso  model  was  developed  as  the  first  step  in  stan¬ 
dardization  of  the  various  protocols  which  exist  in  these 
networks.  The  model  provides  a  basis  for  categorizing  the 
many  complicated  network  operations  into  "layers"  so  that 
rules  and  procedures  belonging  to  a  particular  layer  perform 
a  well  defined  service.  The  layers  are  organized  in  a  hier¬ 
archical  structure  where  each  one  is  built  upon  its  pred¬ 
ecessor.  The  impact  of  using  this  layer  model  is  that 
higher  layers  need  not  be  ccncerned  with  the  details  cf  how 
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the  services  offered  by  the  lover  layers  are  actually 
implemented. 

The  seven  layer  model  arrived  at  by  the  ISO  is  presented 
below  with  a  summary  of  the  distinct  function  which  is 
performed  at  each  layer.  Terminology  used  is  from 
Tannenbaum  [Bef.  3]. 

1.  Physical  layer  -  The  transmission  of  data  bits  over  a 
channel  which  involves  the  mechanical,  electrical  and 
procedural  interfacing  cf  the  network. 

2.  Data  link  layer  -  The  transformation  -of  a  raw  trans¬ 
mission  facility  into  a  line  that  appears  free  of 
errors  to  the  Network  layer.  Protocols  employed 
break  up  the  input  data  into  data  frames,  transmit 
the  frames  se guentia lly ,  and  process  the  acknowledge¬ 
ment  frames  sent  back  from  the  receiver. 

3.  Network  layer  -  The  routing  of  packets  within  the 
network.  Additional  protocols  divide  messages  from 
the  Transport  layer  into  packets  and  provide  measures 
for  control  of  congestion. 

4.  Transport  iajjer  -  The  acceptance  of  data  from  the 
Session  layer  which  is  then  passed  to  the  Network 
layer.  Protocols  ensure  that  data  arrives  correctly 


at  the  other  end.  The  complexity  of  this  layer  is 
therefore  highly  dependent  upon  whether  datagram  or 
virtual  circuits  are  used  in  the  Network  layer. 
Additional  protocols  handle  hierarchical  addressing 
schemes  and  the  multiplexing  of  a  number  of  connec¬ 
tions. 

Session  layer  -  The  establishment  of  a  connection 
between  two  processes  and  the  management  of  the 
dialog  in  an  orderly  manner. 

Presentation  lay er  -  The  performance  of  functions 
that  are  reguested  sufficiently  often  to  warrant 
finding  a  general  solution  for  them,  rather  than 
letting  each  user  solve  the  problem.  Protcccls 
include  encryption  routines  for  message  security, 
character  conversion  and  text  compression. 

Apclicat ion  layer  -  The  content  of  this  layer  is  up 
to  the  individual  user.  Since  the  contents  of  the 
application  layer  are  developed  by  the  network  user 
vice  the  network  designer  (as  with  the  lower  layers), 
few  national  or  international  standard  protcccls 
exist.  Nevertheless,  current  research  dealing  with 
issues  which  are  common  to  many  applications  may  be 
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tie  future  source  cf  •  accepted  protocols.  These 
topics  include  distributed  data  bases  and  distributed 
computation. 

As  tie  layer  level  increases,  so  does  its  relative  level 
of  abstraction.  Tie  lowest  three  layers  (Physical,  Data 
Link,  and  Network)  deal  with  the  actual  transportation  of 
data  within  the  network  itself  and  are  often  refered  to  as 
subnet  layers.  The  functions  cf  the  remaining  four  higher 
layers  can  be  compared- to  those  of  a  virtual  machine  system. 
These  layers  provide  the  user  with  a  connection  to  their 
destination  which  appears  dedicated  to  them  alone.  In  ether 
words,  though  many  users  may  be  simultaneously  using  the 
shared  resources  of  the  network,  their  connections  will 
remain  isolated  from  each  other  through  the  functions  of  the 
subnet  layers. 

In  this  model,  the  routing  procedures  are  a  part  of  the 
Network  layer.  Numerous  different  algorithms  have  been 
proposed  in  the  literature  which  claim  to  find  the  "best 
paths"  within  a  network.  However,  as  will  be  shown  in  the 
next  chapter,  not  all  are  well  suited  for  application  within 
a  distributed  packet-switched  network.  In  providing  the 
general  characteristics  of  the  wide  variety  of  routing 


s\'\  algorithns,  the  rationals  behind  the  selection  of  the 

specific  procedure  used  in  this  work  should  become  acparent. 


II.  BOOTING  PROCEDURES 


k  routing  procedure  for  a  packet-switched  communications 
network  provides  a  set  of  rules  which  guide  packets  from 
their  source  to  destination  nodes.  This  routing  procedure 
cr  algorithm  is  then  that  part  of  the  computer  software 
responsible  for  deciding  on  which  output  line  an  incoming 
packet  should  be  transmitted.  The  resulting  path  a  packet 
takes  is  defined  simply  as  the  collection  of  sequential 
communication  links  ultimately  connecting  source  to 
destination. 

Before .discussing  the  various  routing  procedures  used  to 
select  these  paths  there  are  certain  properties  that  are 
generally  desirable  in  all  such  algorithms:  correctness, 
simplicity,  robustness,  stability,  fairness  and  optimality 
[Ref.  3].  Correct  performance  of  the  algorithm  must  be 
established  prior  to  use  an  d  a  simple  structure  aids  in  both 
implementation  and  speed  of  execution.  k  robust  algorithm 
can  cope  with  changes  in  network  topology  and  traffic 
without  requiring  major  modifications  to  take  place  in  its 
structure  or  use.  Stability  refers  to  a  routing  algorithms 
ability  tc  converge  to  a  state  of  equilibrium.  When  an 

31 


,  'JV  V/.VJ'JjIVC 


unchanging  network  has  stationary  traffic  inputs  then  the 
algorithm  should  converge  to  a  stable  traffic  pattern.  An 
algorithm  which  never  converges,  no  matter  how  long  it  runs, 
is  unstable.  Fairness  and  optimality  are  certainly  desir¬ 
able,  yet  often  contradictory  goals.  This  contradiction  is 
test  seen  by  example.  Suppose  two  high  volume  traffic  users 
share  a  single  communications  link  while  transmitting  to 
another  party.  Due  to  their  combined  traffic,  the  link  is 
used  to  full  capacity  and  thus  exhibits  maximum  traffic 
throughput.  If  the  criterion  for  optimization  is  maximum 
traffic  flow,  then  the  situation  is  optimal.  However,  if  a 
lower  volume  user  reguests  to  send  traffic  over  that  link, 
it  will  he  denied  since  the  traffic  flow  would  be  reduced  if 
the  user  were  allowed  to  use  the  link.  Evidently,  seme 
compromise  between  global  efficiency  and  fairness  to  indi¬ 
vidual  connections  is  needed. 

i.  LINK  HEIGHT  FUNCTION 

Most  routing  algorithms  used  in  packet  networks  turn  out 
to  be  variants,  in  one  form  or  another,  of  shortest  path 
algorithms.  These  procedures  achieve  optimality  by  routing 
packets  from  source  to  destination  over  a  path  of  "least 
cost".  In  establishing  a  criterion  function  the  designer 


assigns  a  positive  cost  to  each  link  which  a  packet  incurs 
when  it  travels  over  that  link.  These  "link  weights"  are 
evaluated  based  upon  a  specific  commodity  which  the  designer 
is  seeking  to  minimize.  The  link  weight  function,  then, 
assigns  a  numeric  value  to  all  links  which  the  routing  algo¬ 
rithm  uses  in  its  computation  of  the  least  cost  cr  best 
Faths  of  travel  throughout  the  network. 

The  parameters  upon  which  the  link  weight  is  dependent 
are  set  by  choice  cf  the  designer.  Some  networks  use  a 
fixed  weight  for  each  link  in  the  network,  the  weight  being 
inversely  proportional  to  the  link  capacity  in  bits  per 
second.  Por  a  network  with  equal  capacity  links,  minimiza¬ 
tion  of  the  cost  produces  a  least  "hop"  routing  scheme,  a 
hop  being  a  trip  over  a  single  link.  Links  with  a  high 
error  rate  or  poor  signal  to  noise  characteristics  may  be 
given  higher  weights,  steering  traffic  away  from  them. 
Heights  may  be  assigned  depending  upon  the  type  of  traffic 
transmitted  with  a  higher  weight  given  to  computer  file 
transfers  than  to  interactive  terminal  usage,  in  attempting 
to  minimize  average  packet  delay,  link  weights  could  be 
based  upon  estimates  cf  average  packet  delay  times  over  that 


B.  FGOTIHG  CLASSES 

In  choosing  the  link  weight  function,  the  designer  makes 
a  crucial  decision  concerning  the  performance  of  the 
network.  If  link  weights  are  not  a  function  of  parameters 
involving  estimates  of  current  traffic  and  topology,  the 
algorithm  will  be  deterministic.  However,  if  link  weights 
are  a  function  cf  these  parameters  then  the  algorithm  will 
he  adaptive.  A  third  class,  called  hybrid  algorithms,  use 
link  weight  functions  which  behave  both  deterministically 
and  adaptively  depending  upcn  network  conditions. 

1  •  Deterministic  Routing 

Deterministic  routing  (i.e.  static,  non-adaptive, 
directory  routing)  uses  fixed  routing  tables  which  were 
computed  with  unchanging  link  weights.  With  deterministic 
strategies,  the  path  for  any  source-destination  node  pair  is 
determined  a  priori  and  is  independent  of  normal  traffic 
variations.  This  class  cf  algorithms  do  not  adapt  to 
changes  in  network  traffic  but  are  designed  to  provide 
satisfactory  performance,  cn  the  average,  over  a  range  of 
traffic  intensities. 

A  simple  exaiple  of  a  deterministic  routing  algo¬ 


rithm  is  the  least  hep  scheme  in  which  all  link  weights  are 


equal.  This  method  could  be  selected  when  the  traffic 
pattern  is  balanced,  i.e.  the  link  utilization  of  different 
links  is  approximately  the  same.  Under  such  conditions,  the 
average  delay  of  a  packet  vill  be  minimized. 

A  more  complex,  though  still  deterministic  algo¬ 
rithm,  is  to  expand  the  routing  table  to  include  alternate 
paths.  Therefore,  for  each  possible  destination,  the  ncde 
would  have  a  first,  second,  third,  etc.  outgoing  link  whose 
selection  would  be  based  on  a  predetermined  plan.  A  better 
basis  cf  assignment  is  to  have  a  specified  fraction  of 
entering  packets  corresponding  to  a  particular  source- 
destinaticn  pair  be  routed  ever  each  outgoing  link. 

The  selection  of  these  "routing  fractions"  can  be 
made  in  an  ad  hoc  fashion.  However,  if  the  incoming  traffic 
statistics  for  the  network  are  known  then  better,  although 
more  co mplicat ed ,  iterative  approaches  can  be  used.  The 
determination  of  the  routing  policy  can  be  based  upon  mini¬ 
mizing  the  average  scurce-t o-destination  packet  delay.  This 
type  of  minimization  problem  is  a  convex  multicommodity 
problem  on  a  convex  constraint  set.  The  important  feature 
cf  this  type  of  ainiiization  problem  is  that  the  solution  is 
a  unique  local  minimum,  which  is  also  the  global  minimum. 


This  means  that  the  solution  will  be  the  optimal  routing 
solution  for  the  given  static  situation.  A  number  of 
optimal  techniques  for  the  solution  of  multicommodity  flow 
problems  are  found  in  the  literature  which  have  a  wide  range 
cf  ccmputational  efficiencies  [Hef.  4]. 

Another  type  cf  deterministic  approach  is  called 
"flooding".  Each  node  receiving  a  packet  simple  retransmits 
it  over  all  outgoing  links.  This  technique  is  sinple  and 
robust.  Flooding  always  chocses  the  shortest  path,  because 
it  chocses  every  path  in  parallel.  The  obvious  drawback  is 
the  network  being  cverwhelmed  with  multiple  copies  cf  a 
message. 

The  advantage  of  deterministic  routing  is  its 
simplicity  cf  implementation,  since  little,  if  any,  dynamic 
calculation  or  signaling  information  is  required.  Important 
too  is  the  fact  that  these  methods  provide  good,  if  not 
optimal,  performance  under  conditions  for  which  they  were 
designed.  The  main  drawback  cf  non-adaptive  schemes  is  just 
that,  they  do  not  adapt.  Static  routing  is  often  designed 
based  upon  mean  traffic  patterns,  but  for  chaotic  and  unbal¬ 
anced  traffic  environments,  they  are  not  adequate  (Ref.  5]. 
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2.  Adaptive  Boating 


Adaptive  or  dynamic  routing  algorithms  utilize  link 
weight  functions  containing  parameters  which  are  measure¬ 
ments  or  estimates  cf  the  current  traffic  or  topology  of  a 
network.  In  general,  adaptive  'routing  procedures  can 


usually 

be  differentiated  by 

two 

criteria; 

how  dynamic 

t  hey 

are  and 

where  the  algorithm 

is  implemented. 

The  dynamic  feature 

of 

an  algorithm  concerns 

how 

rapidly 

and  in  wbat  manner 

it 

adapts  to 

changes  in 

the 

network.  The  best,  although  ncnrealizable,  algorithm  would 
be  one  where  instantaneous  and  global  knowledge  of  the 

network  status  was  available  upon  which  routing  decisions 

« 

were  made.  This  "ideal  observer",  would  always  route  traffic 
in  the  optimal  fashicn.  Since  this  is  not  possible,  adap¬ 
tive  algorithms  depend  upon  making  estimates  of  traffic 
conditions,  reflecting  these  estimates  using  link  weights, 
and  then  computing  rew  routes.  While  adaptive  routing 
strategies  appear  mere  attractive  than  deterministic  cnes, 
the  overhead  traffic  caused  by  routing  updates  and  the  prac¬ 
tical  difficulty  involved  in  accurately  reflecting  the 
current  traffic  conditions  can  make  the  choice  unclear. 
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a.  Centralized  Routing 


Under  centralized  control,  a  central  node  in  the 
network  receives  status  information  from  all  other  nodes, 
processes  this  information,  and  then  computes  the  new  best 
path  routing  table,  based  upon  this  global  knowledge.  The 
attractivenes  of  this  scheme  lies  in  the  ability  of  the 
central  node  to  make  routing  decisions  based  upon  global 
knowledge  and  the  alleviation  of  routing  computation  by 
ether  nodes. 

However  the  drawbacks  are  serious,  if  not  fatal. 
Putting  "all  its  eggs  in  one  basket",  this  system  is  hardly 
robust,  with  failure  of  the  central  node  being  catastrophic 
’  for  the  network.  There  are  also  problems  related  to  a  heavy 
concentraticn  of  routing  traffic  near  the  central  rode. 
Finally  there  exists  the  more  basic  "chicken  and  egg" 
predicament  where  one  needs  routes  to  transmit  status  infor¬ 
mation  reguired  to  establish  routes. 

Numerous  centralized  algorithms  can  be  found  in 
the  literature.  An  algorithm  proposed  by  Dijkstra  [Ref.  6] 
deserves  mention  due  to  its  popularity.  Because  of  its 
computational  efficiency,  it  is  used  as  a  basis  cf  compar¬ 
ison  in  the  next  chapter.  The  Dijkstra  algorithm  uses  a 
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"tree  growing"  technique  in  which  the  source  node  is  the 
base  of  the  tree.  Through  an  iterative  process,  nodes  which 
constitute  the  shortest  path  from  the  source  to  the  destina¬ 


tion  receive  a  "permanent"  label.  This  label  contains  the 

* 

identity  of  the  node  which  is  the  next  hop  to  the  source 
node.  The  algorithm,  in  its  basic  form,  terminates  when  the 
destination  node  is  permanently  labeled.  If  it  is  desired 
to  find  the  shortest  paths  from  the  source  to  all  nodes 
within  the  network,  then  the  algorithm  is  simply  repeated 
until  all  nodes  are  permanently  labeled.  To  complete  a 
centrali2ed  routing  table  for  the  entire  network,  a  mere 
computationally  efficient  matrix  implementation  of  the  algo¬ 
rithm  is  available. 

t.  Isolated  Pouting 

On  the  opposite  end  of  the  spectrum  from 
centralized  algorithms  are  procedures  in  which  nodes  make 
routing  decisions  based  only  c'n  information  they  themselves 
have  gleaned.  With  isolated  routing,  nodes  exchange  no 
routing  information  with  other  nodes.  These  methods  still, 
however,  try  to  adapt  to  changes  in  topology  and  traffic. 

A  simple  example  of  an  isolated  scheme  is  the 
"hot  petate"  algorithm.  When  a  packet  arrives,  the  nede 
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tries  to  get  rid  of  it  as  fast  as  possible  by  putting  it  on 
the  queue  of  the  output  link  which  is  shortest. 


The  advantage  of  these  algorithms  is  the  absence 
cf  update  traffic  while  the  disadvantages  are  related  to 
much  less  than  optimal  path  selection  due  to  limited  knowl¬ 
edge.  This  brings  out  the  ongoing  battle  between  the 
benefits  of  up-to-date  status  information  for  decision 
making  and  the  burden  this  places  on  the  network  in  the  fcrm 
cf  high  overhead  traffic. 

c.  Distributed  Routing 

With  distributed  algorithms,  each  node 

constructs  its  own  routing  table  using  periodic  updating 
information  from  neighboring  nodes.  The  algorithms  are 
distributed  in  the  sense  also  that  no  central  routing  tables 
are  required  and  there  is  no  global  knowledge  of  the 
topolcgy  cf  the  routes.  Each  node  knows  only  its  adjacent 
nodes  and  from  amongst  them,  chooses  a  "preferred"  neighbor 
for  each  destination  cede. 

Distributed  algorithms  have  many  features  which 
make  them  attractive  for  packet-switched  communications 
networks.  They  are  robust  due  to  their  lack  of  dependence 
upon  a  central  node  for  rcuting  information.  They  also 
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possess  the  ability  to  react  quickly  to  local,  disturbances 
at  the  pcint  of  disturbance  with  slower  "fine  tuning"  in  the 
rest  cf  the  network. 

The  routing  algorithm  used  in  the  ARPANET  since 
Hay  1979  employs  a  modified  version  of  the  Dijkstra  algo¬ 
rithm  in  a  distributed  manner  [Ref.  7].  Each  node  indepen¬ 
dently  computes  its  own  routing  table  using  this  Dijkstra 
modification  which  is  called  the  "shortest-path-f irst"  algo¬ 
rithm.  The  modifications  allow  the  algorithm  to  handle 
various  possible  changes  in  link  wieghts  without  having  to 
recalculate  the  whole  Spanning  tree. 

Link  weights  are  evaluated  in  terms  cf  time 
delays  on  the  link.  Each  ncde  calculates  an  estimate  of  the 
delay  on  each  of  its  outbound  links  by  averaging  the  total 
packet  delay  over  a  ten  second  interval.  Since  all  nodes 
must  he  informed  of  link  weight  changes,  a  flooding  tech¬ 
nique  is  used  to  forward  the  information  throughout  the 
network.  Tc  reduce  overhead,  a  link  weight  update  is  trans¬ 
mitted  only  when  the  change  in  weight  since  the  last  trans¬ 
mission  has  exceeded  a  certain  threshold.  Upon  receipt  of  a 
new  link  weight  update,  the  shortest-path- first  algorithm 
restructures  its  shortest  path  tree. 


Gallager  [Bef.  8]  proposed  a  distributed  routing 
algorithm  which  makes  use  cf  the  routing  fraction  concept 
discussed  earlier  in  the  deterministic  routing  section  of 
this  chapter.  Dnlike  the  static  scheme,  these  routing  frac¬ 
tions  are  functions  cf  information  communicated  between 
adjacent  nodes.  The  information  in  the  update  message  is 
related  tc  the  marginal  delay  to  each  destination.  The 
algorithm  sends  packets  over  routes  which  minimize  the 
overall  delay  of  all  messages,  vice  attempting  to  send 
packets  ever  a  route  that  minimizes  their  own  delay  with  no 
regard  to  that  of  other  packets.  The  basic  notion  which  the 
algorithm  exploits  is  that  a  change  in  link  flow  causes  a 
marginal  change  in  network  delay. 

Gallager  demonstrates  that  the  algorithm 
converges  to  the  minimum  average  delay  for  a  network  with 
stationary  inputs  and  links.  The  question  as  to  whether  the 
algorithm  could  adjust  fast  enough  to  keep  up  with  changing 
statistics  is  still  the  subject  of  study.  Faster  network 
changes  would  necessitate  more  frequent  updating  of  the 
algorithm.  Besides  the  usual  problems  of  increased  over¬ 
head,  frequent  updates  would  also  cause  noisier  measurements 
cf  marginal  link  delays  and  node  flows. 
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Another  distributed  algorithm  is  presented  by 
Segall  and  Merlin  (Bef.  9  ]  which  uses  the  spanning  tree 
concept  cf  graph  theory.  A  spanning  tree  is  a  connected 
partial  graph  (all  nodes  and  a  subset  of  links)  containing 
to  loops.  A  normal  update  cycle  would  begin  from  the  desti¬ 
nation  node  at  the  base  of  the  tre9.  The  cycle  would  propa¬ 
gate  up-tree  (on  the  spanning  tree)  ,  modifying  the  weight 
estimates  from  each  rode  to  the  destination  node  and  then 
propagate  dcwn-tree  while  updating  the  best  path  neighbors 
for  each  node.  Each  cycle  tends  to  find  the  best  path  from 
each  node  tc  the  destination  node.  As  with  Gallager's  algo¬ 
rithm,  the  paths  are  also  loop  free  at  every  iteration. 

In  comparing  the  last  two  distributed  algo¬ 
rithms,  there  is  a  fundamental  difference  in  how  they  seek 
to  minimize  their  cost  functions.  Gallagher's  algorithm 
produces  a  set  of  routing  fractions  which  tell  the  node  what 
percentage  of  traffic  for  a  particular  destination  is  to  be 
placed  on  each  of  its  outgoing  links.  To  dramatize  the 
point  assume  100  packets  destined  for  node  J  arrive  at  node 
I.  The  current  routing  fractions  state  that  50%  of  all 
traffic  for  node  J  is  to  travel  on  link  (I, A),  30%  on  link 
(I , B)  and  20%  on  link  (I,C).  Node  I  would  then  place  50 
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30  packets  in  link  queue  (1,8) 


packets  in  link  gueue  (I, A)  , 
and  20  packets  in  link  queue  (I,C). 

Segall's  algorithm;  on  the  other  hand,  produces 
a  routing  tahle  which  lists  a  "preferred"  neighbor  for  each 
destination.  If  the  same  situation  had  occurred  using  this 
algorithm  then  all  ICO  packets  would  have  been  placed  into 
one  link  gueue.  It  would  appear  in  the  case  of  algorithms 
providing  a  single  path  routing  table,  that  this  does  not 
mean  that  at  any  given  instant  all  traffic  arriving  at  a 
node  destined  for  another  should  be  sent  via  the  single 
path.  The  policy  of  cnly  incrementally  increasing  the  frac¬ 
tion  of  traffic  routed  to  the  preferred  neighbor,  while 
(incrementally)  easing  the  lead  to  other  routes  seems  mere 
suitable.  In  this  way,  the  best  estimated  route  becomes 
somewhat  more  loaded,  whereas  the  others  become  less  leaded, 
thereby  improving  network  performance. 

Another  distributed  routing  algorithm  which 
operates  on  a  substantially  different  principle  was  written 
by  Ten  [Bef.  10}.  That  principle,  and  the  other  character¬ 
istics  of  the  Ten  algorithm  are  investigated  in  the 
following  chapters. 
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3.  lifers  Rcutijs 


Hybrid  routing  is  a  strategy  based  upon  the 
hypothesis  that  a  combination  of  deterministic  and  adaptive 
schemes  will  probatly  achieve  the  best  results.  Chow 
£Hef.  5]  states  that  for  the  routing  procedures  which  have 
been  implemented,  adaptive  routing  procedures  are  good  for 
certain  traffic  conditions  and  deterministic  ones  for 
ethers.  Chow  concludes  that  a  hybrid  algorithm  must  behave 
deterministically  when  traffic  so  warrants  and  adaptively 
otherwise. 

Hybrid  algorithms  must  utilize  a  link  weight  func¬ 
tion  which  is  able  tc  produce  nonvarying  weights  when  deter¬ 
ministic  network  conditions  prevail  and  highly  variable 
weights  when  adaptive  network  conditions  exist.  This  link 
weight  function,  then,  must  not  be  sensitive  to  small  varia¬ 
tions  in  the  traffic.  That  is,  if  there  are  only  incre¬ 
mental  variations  and  thus  small  fluctuations  in  path 
weights  of  possible  routes,  then  the  current  route  does  not 
change.  This  prevents  detrimental  oscillations  or 
"churning”  between  closely  weighted  paths  which  can  result 
in  unnecessary  packet  delays. 
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The  ARPANET  is  an  operational  packet-switched 
network  which  implements  a  hybrid  scheme.  Since  1979  this 

network  has  used  a  link  weight  function  [sef.  11]  which  can 

he  generalized  into 

W(I,J)  =  fc  ♦  CQ  (I ,  J) 

where  Q(I,J)  is  the  link  queue  size  at  the  time  of  routing 
update  and  t  >  c.  In  this  scheme  when  traffic  is  reasonably 
balanced,  the  constant  b  determines  a  fixed  path  for  each 
source-destination  Fair  and  the  routing  strategy  behaves 
like  a  deterministic  one.  Otherwise,  the  difference  in 
queue  buildup  of  alternate  paths  becomes  substantial, the 
impact  of  the  cQ(I,J)  ter®  increases,  and  the  routing 

becomes  adaptive.  Chow  considers  a  third  term,  dc2(l,j), 

such  that  the  link  weight  function  is 

»(I,J)  *  b  «•  cQ(I,J)  ♦  dQ2  (I, J) 

and  c  >  d.  His  simulation  verified  that  this  link  weight 
function  provides  a  good  compromise.  The  actual  values  of 
t,  c  and  d  and  the  frequency  of  updates  depended  upon  the 
network  topology  and  traffic  condtions. 

The  development  of  a  hybrid  routing  system  based 
upon  the  Yen  distributed  routing  algorithm  and  a  newly 


devised  link  weight  function  is  presented  in  the  following 
chapters-. 


C.  CCHGESTIOI  CCHTBCI 

In  presenting  the  functions  of  the  Network  layer,  an 
additional  protocol  besides  routing  was  mentioned,  namely 
congesticr  control.  Congestion  control  was  introduced  as  a 
separate  area,  but  as  one  can  surmise  from  the  material  in 
this  chapter,  both  these  topics  are  intimately  related.  To 
see  their  relationship,  the  characteristics  of  congestion 
must  first  be  understood. 

Congestion  can  be  described  as  the  state  of  a  network 
where  mere  offered  traffic  results  in  less  carried  traffic. 
Congestion  is  not  the  graceful  approach  to  the  network's 
maximum  throughput  but  rather  the  deterioration  away  from 
this  value  as  traffic  intensity  increases  beyond  some  point. 
This  point  can  occur  when  network  resources  are  no  longer 
able  to  accomodate  the  traffic.  Whether  congestion  begins 
simultaneously  throughout  the  network  or  in  a  particular 
region,  if  left  unchecked  it  tends  to  feed  upon  itself  and 
become  worse.  This  can  lead  to  such  a  degraded  condition 
that  no  transmission  can  take  place  at  all.  Whin  deadlock 
cr  lockup  happens,  the  network  ceases  to  function  and  will 
stay  that  way  unless  special  procedures  are  invoked. 


The  relationship  between  the  '  congestion  process  and  the 
available  network  resources  will  be  illustrated  beginning 
with  the  use  of  an  "ideal”  packet-switched  network.  Ideal 
means  that  each  node  has  infinite  buffer  capacity,  each 
microprocessor  has  a  perfect  routing  algorithm,  and  each 
link  has  infinite  capacity.  Within  this  network,  since 
packets  travel  instantaneously  from  node  to  node  over  the 
test  path,  congestion  cannot  occur.  Offered  traffic  can 
never  exceed  the  limits  of  a  network  with  unlimited 
capacity. 

Suppose  now  that  the  links  are  made  more  realistic  and 
given  finite  capacity  with  attendent  propagation  delays. 
Nothing  else  in  the  network  is  changed.  In  this  case,  since 
the  routing  algorithm  is  perfect,  incoming  traffic  will  be 
distributed  within  the  network  such  that  the  limiting 
resource  (the  link  capacity)  is  efficiently  used.  However, 
as  the  intensity  increases,  the  finite  link  capacity  will 
eventually  reach  saturation  resulting  in  queue  build  up  and 
packet  delays.  With  a  perfect  routing  algorithm,  when  the 
network  limit  is  reached,  several  nodes  or  links  will  become 
blocked  at  the  same  time.  Had  the  routing  algorithm  been 

‘t 

less  than  perfect,  the  congestion  would  have  started  at  a 


smaller  traffic  intensity  since  the  network  resources  would 
be  less  skillfully  allocated. 

The  final  tcuch  of  realism  for  the  network  is  the  use  of 
finite  capacity  queues.  Under  this  limitation,  all  packets 
arriving  at  a  node  fcr  which  there  is  no  queue  space  are 
simply  discarded.  Congestion  would  not  occur  in  this 
network,  tut  the  process  of  packet  discarding  (although  used 
in  some  networks)  seems  a  drastic  solution  to  the  problem. 

From  this  scenario,  the  role  of  routing  is  seen  as 
congestion  "avoidance"  vice  congestion  "elimination".  Even 
perfect  routing  can  not  stop  congestion  when  the  network 
traffic  limit  is  exceeded.  Although  good  routing  protocols 
will  increase  the  lead  that  a  network  can  take,  it  follows 
that  the  elimination  of  congestion  must  start  prior  to 
packets  entering  the  network.  Once  a  packet  has  been 
accepted  into  the  network,  the  best  that  can  be  dene  is  to 
provide  rcutes  sc  as  to  avoid  congestion.  But  if  too  many 
packets  are  allowed  into  the  network,  congestion  is 
inevitable. 

The  methods  of  congestion  control  presented  in  the 
following  paragraphs  are  those  which  act  prior  to  a  packet 
entering  the  network.  The  "isarit hmic"  method  by  Davies 


[Hef.  12]  is  a  techirique  which  places  a  limit  on  the  total 
number  of  packets  in  the  network.  The  network  contains 
permits  which  circulate  about.  A  packet  requires  a  pernit 
to  travel  in  the  netwcrk  and  upon  reaching  the  destination, 
the  permit  is  recirculated.  This  simple  rule  en'sures  that 
the  number  of  packets  in  the  network  will  not  exceed  the 
number  of  permits. 

If  virtual  circuits  are  used  in  a  packet-switched 
network,  a  simple  congestion  control,  scheme  is  to  allow  each 
virtual  circuit  to  reserve  buffer  space  at  each  node  along 
its  path.  If  buffer  space  at  any  node  is  hot  available,  the 
caller  gets  a  "busy”  signal  and  the  circuit  is  not 
completed.  This  preallocation  of  buffers,  however,  results 
in  some  inefficiency  since  resources  assigned  but  not  actu¬ 
ally  being  used  in  connections  are  not  available  to  anyone 
else. 

Another  method  proposed  by  Majithia  (Ref.  13]  uses  a 
mechanism  which  is  triggered  only  when  the  system  is 
congested.  The  "warning”  of  impending  congestion  is  trans¬ 
mitted  throughout  the  netwcrk  by  means  of  choke  packets. 
The  chcke  packets  act  as  a  negative  feedback  source  which  is 
then  used  by  nodes  to  throttle  incoming  traffic. 
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The  mechanise  kncwn  as  flow  control  is  often  included  in 
the  set  of  solutions  for  the  problem  of  congestion  control 
in  packet-switched  networks.  The  term  is  used  throughout 
the  literature  and  net  without  some  confusion.  In  under¬ 
standing  the  possible  applications  of  flow  control,  it  is 
first  necessary  to  clarify  what  flow  control  is  and  how  it 
differs  fundamentally  from  congestion  control. 

Mcst  authors  use  flow  control  to  mean  the  mechanism  by 
which  a  receiver  throttles  a  sender  to  prevent  data  from 
arriving  at  a  rate  faster  than  the  receiver  can  handle  it. 
Elow  control  seeks  tc  allocate  network  resources  for  user- 
receiver  pairs  as  long  as  they  are  available.  Usually  the 
implementation  of  flew  control  is  at  the  Transport  layer 
between  source  and  destination  nodes  (end-to-end  flow 
control)  but  sometimes  the  term  is  applied  to  protocols 
between  neighboring  redes. 

Numerous  flow  control  schemes  are  .presented  in  the 
literature  although  usually  they  involve  the  implementation 
of  one  of  only  a  limited  number  of  throttling  tools.  Pouzin 
[Hef.  14]  summarizes  them 
categories: 


as  being  i 


the  following 


1.  Stop  and  Go  -  The  source  either  can  send  traffic 
withcut  limit-,  or  it  is  barred  from  transmitting. 

2.  Credit  -  The  sender  cannot  transmit  unless  it  has 
received  from  the  receiver  an  indication  about  the 
amcunt  of  traffic  that  can  be  accepted. 

3.  Hate  -  The  sendee  cannot  transmit  traffic  above  a 
predetermined  rate. 

4.  Delay  -  As  delay  increases  between  source  and  desti¬ 
nation,  the  seeder  is  throttled. 

5.  Class  -  Traffic  is  offered  with  a  class  indicator, 
when  enough  resources  are  available,  all  offered 
traffic  is  accepted.  Otherwise,  some  classes  are 
restricted  depending  upen  criteria  which  appears  to 
strike  an  acceptable  balance  between  conflicting  user 
demands. 

The  flow  control  schemes  using  Credit  and  Delay  appear 
particularly  suited  fer  controlling  congestion.  Situations 
can  occur  where  many  nodes  within  a  network  are  transmitting 
to  the  same  destination  node.  Even  if  their  individual 
transmission  rates  are  low,  the  destination  node  may  net  be 
able  to  handle  the  combined  traffic  load.  Both  the  credit 
and  delay  schemes  wculd  be  able  to  sense  the  beginnings  of 
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congestion  through  the  termination  of  credits  from  the 
receiver  or  the  increase  in  packet  delay.  Traffic  tc  the 
destination  node  .  could  then  be  throtteled  to  avoid 
congestion. 

In  contrast,  the  Stop  and  Go  and  Rate  schemes  may  net  be 
as  effective  in  controlling  congestion.  These  flow  control 
schemes  require  the  sender  to  stop  sending  at  some  point  and 
wait  for  an  explicit  go-ahead  message,  or  permit  the- 
receiver  to  simply  discard  packets  at  will  with  impurity. 
The  atility  to  select  the  cut-off  "point"  for  the  protocol 
which  satisfies  a  total  network  requirement  is  the  real 
problem.  If  the  pcint  is  determined  based  upon  average 
network  operating  levels  then  these  particular  flow  control 
schemes  will  provide  poor  service  for  bursty  traffic.  On- 
the  other  hand,  if  peak  levels  are  used  then  they  end  up 
providing  no  control  at  all. 
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HI.  ISE  2JH  SHORTEST  PAJIJ  ALGORITHM 


With  the  abundance  of  shortest  path  algorithms  in  the 
literature  [Ref.  15  ],  there  was  a  need  to  develop  criterion 
for  selection  of  one  method  over  another.  Immediately,  all 
centrali2«d  shortest  path  algorithms  were  eliminated  due  to 
the  gcal  of  creating  a  truly  decentralized  communications 
system.  This  reduced  the  number  of  choices  by  a  substantial 
amount.  The  following  characteristics  were  then  sought 
after  in  the  remaining  decentralized  shortest  path 
algorithms. 

1.  Algorithms  should  not  require  knowledge  of  the 
complete  network  topology. 

2.  Algorithms  should  be  efficient  (i.e.  require  as  few 
as  possible  computational  steps  for  the  node's  micro¬ 
processor)  . 

3.  Information  exchanged  between  network  nodes  required 
fcr  algorithm  to  function  should  be  a  minimum. 

Based  upcn  these  criterion,  the  Yen  shortest  path  algorithm 
was  chosen  [Ref.  10].  Both  Gallagher's  and  segall's  algo¬ 
rithms  satisfied  condition  (1)  ,  however  Gallagher's  was  not 
as  computationally  efficient  and  Segall's  required  mere 
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exchange  cf  information  (the  dual  nature  of  its  spanning 
tree  update  cycle)  between  nodes  than  the  algorithm  proposed 
by  Yen.  Not  only  does  the  Yen  algorithm  satisfy  the  desired 
requirements,  but  it  also  exhibits  unique  features  which 
were  cf  particular  interest  for  this  research.  In  addition, 
and  perhaps  foremost,  was  the  fact  that  this  algorthim  has 
not  teen  thoroughly  studied  in  actual  network  simulations. 

A.  DESCBIETIOH 

The  key  word  in  understanding  and  analyzing  the  Yen 
shortest  path  algorithm  is  "time”.  The  manner  in  which  the 
algorithm  makes  use  cf  time  in  arriving  at  the  shortest  path 
between  nodes  of  a  network  is  quite  unique.  This  was  the 
cnly  algorithm  reviewed  by  this  author  that  even  approached 
the  protlem  in  this  fashion.  The  necessary  assumptions  for 
applying  the  algorithm  are  as  follows: 

1.  Each  node  in  the  network  is  equipped  with  transmis¬ 
sion  and  computation  facilities  and  a  timing  device 
called  a  clock. 

2.  Each  node  J  knows  a  set  of  nodes,  called  Neighbor(in) 
ncdes,  each  cf  which  is  connected  to  a  node  J  by  a 
directed  link  from  the  Neighbor  (in)  node  to  ncde  J. 


called 


3.  Each  node  J  knows  a  set  of  nodes. 

Neighbor  (out),  nodes,  each  of  which  is  connected  to 
node  J  by  a  directed  link  leading  from  node  j  to  the 
Neighbor  (out)  node. 

4.  Each  node  J  knows  the  weight  of  each  of  the  links 
connecting  ncde  J  to  the  Neighbor  (out)  nodes. 
Height,  again  refers  to  the  assigned  cost  of  using 
that  link. 

5.  Each  node  J  Maintains  a  list  consisting  of  certain 
Neighbor  (out)  nodes,  called  an  Update  Transmission 
List,  which  are  to  receive  the  transmission  cf  update 
message  "J" . 

Por  most  data  communication  networks,  there  will  be  a  full 
duplex  link  between  node  pairs  so  that  the  set  of 
Neighbor  (in)  and  Neighbor  (o ut)  nodes  would  be  identical  for 
a  given  node.  •  Tq  simplify  the  discription  to  follow. 
Neighbor  will  refer  to  a  terminating  node  of  a  full  duplex 
link.  The  clock  is  the  only  item  which  is  peculiar  tc  the 
application  of  this  algorithm.  However,  since  each  micro¬ 
processor  has  a  clock  associated  with  it, 
hardware  is  required. 


c  c. 


no  additional 


The  algorithm  for  finding  the  shortest  paths  from  all 
nodes  to  a  destination  node  K  is  contained  in  Appendix  A. 
The  activity  of  the  algorithm  begins  with  node  K  transmit¬ 
ting  the  update  message  ”K”  to  all  of  its  Neighbors  at  the 
same  time.  The  actions  which  a  node  takes  upon  reception  of 
an  update  are  broken  down  into  five  parts  within  Step  2  of 
the  algorithm.  These  actions  are  summarized  as  follows: 

1 .  Revise  the  Ppdate  Transmission  List  (Step  2.  A).  This 
list  contains  those  Neighbors  which  are  to  receive 
the  update  sent  from  this  node.  Each  time  a  node 
receives  an  update  from  a  Neighbor,  that  Neighbor  is 
removed  from  the  Update  Transmission  List.  This 
process  prevents  update  message  "looping”. 

2.  '  Calculate  the  Opdat e  Reception  Weight  (Step  2.  E)  . 

The  basic  operation  of  the  algorithm  is  the  mapping 
of  the  time  of  reception  of  an  update  message  into  an 
Update  Reception  Weight.  The  relationship  between 
the  time  of  reception  and  the  Update  Reception  Weight 
is  a  direct  proportion  (using  the  constant  C)  such 
that  updates  arriving  at  later  times  will  result  in 
larger  Reception  Weights. 


3.  Determine  the  Ten tat ive  Shortest  Path  Distance  (Step 
2.C) .  The  Update  Reception  Weight  is  added  tc  the 
weight  of  the  link  tc  the  node  from  which  the  update 
message  had  been  sent.  If  node  2  received  an  update 
frcm  node  4  this  "reverse  link  weight"  .would  be 
i(2,4).  The  tctal  of  the  two  weights  is  the  shortest 
path  distance  to  the  destination  node  via  the  reverse 
link.  To  provide  a  degree  of  differentiation,  the 
term  "distance"  will  be  used  in  reference  to  the 
total  weight  cf  a  path  or  route  consisting  cf  one  or 
mere  links.  This  path  distance  is  then  compared  to 
the  previously  computed  shortest  path  distance  with 
the  smaller  cf  the  twe ^becoming  the  new  tentative 
shortest  path. 

4 .  Sche dul e  the  lentat ive  Time  of  Update  Transmission 
(Step  2.D).  The  tentative  shortest  path  distance  is 
mapped  into  a  corresponding  time  value.  When  this 
time  occurs,  the  update  message  will  be  sent  tc  all 
Neighbors  in  the  Update  Transmission  List. 

5.  Transmit  the  Update  (Step  2.E).  At  the  moment  the 
time  of  update  transmission  occurs,  the  message  is 
sent  to  all  nodes  in  the  Update  Transmission  List. 
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Tc  aid  in  understanding  the  operation  of  the  algorithm  a 


simple  example  is  given.  Figure  3.1  presents  a  four  node 
network  which  is  used  to  demonstrate  the  algorithm  in  its 
tasic  form.  The  numbers  near  the  beginning  of  each  link  are 


Figure  3.1  Algorithm  Demonstration  Network 


their  weights,  W(I,J).  Before  proceeding  with  this  example 
it  must  be  pointed  out  that  the  Yen  algorithm  in  its  tasic 
form  cannot  be  applied  to  an  actual  network.  The  propaga¬ 
tion  and  processing  delays  present  in  real  systems  must  be 
taken  into  account  and  thus  some  modifications  have  to  be 
made.  Also  when  the  algorithm  is  applied  to  find 
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simultaneously  the  shortest  paths  to  many  destination  nodes, 
the  simple  update  message  presented  in  the  algorithm  must  be 
changed  to  include  additional  identifying  information.  Beth 
of  these  modifications  were  performed  prior  to  implementa¬ 
tion  into  the  simulation  but  are  not  essential  in  under¬ 
standing  the  fundamentals  of  the  algorithm. 

In  this  example,  node  1  will  be  the  destination  node. 
At  the  conclusion  of  the  algorithm  all  nodes  in  the  network 
will  know  the  next  node  along  the  best  path  to  take  to  node 
1.  The  algorithm  begins  by  initializing  all  tentative  shor¬ 
test  path  distances  and  their  corresponding  time  value  to 
infinity.  The  Update  Transmission  List  of  each  node 
initially  contains  all  the  node's  Neighbors.  The  constant  C 
which  relates  path  distance  to  time  is  set  to  unity  for  ease 
in  understanding  the  operation  of  the  algorithm. 

At  time  0,  node  1  sends  its  Neighbor  nodes  2  and  3  the 
simple  message  "I".  Since  no  propagation  delay  is  assumed, 
nodes  2  and  3  both  receive  the  message  "1"  at  the  same  time 
0.  Eeing  a  distributed  system,  both  nodes  begin  performing 
the  algorithm  upon  receipt  of  the  update  message.  The 
activity  at  node  2  is  first  observed.  A  descriptive  format 


is  utilized  in  presenting  the  algorithm  steps  which  are 


performed  at  each  ncde .  The  algorithm  step  label  from 
Appendix  A  is  included  with  each  corresponding  action. 


Step  2. A;  Node  2  deletes  node  1  from  its  Update 
Transmission  List.  This  eliminates  the  possiblilty  of 
sending  an  update  to  a  node  from  which  one  has  already  been 
received. 

Step  2.B;  The  clock  is  read  and  the  time  of  reception 
cf  the  update  from  rede  t  over  the  link  (1r2)  is  noted. 
This  time  is  then  mapped  into  a  Reception  Weight.  Since  the 
time  of  reception  was  0  and  the  mapping  multiplier,  C, 
equalled  1,  the  value  cf  the  Update  Reception  Weight  was  0. 

Step  2.C;  The  Update  Reception  Weight  is  added  to  the 
actual  weight  of  the  reverse  link  (2,1)  resulting  in  the 
path  distance.  This  path  distance  is  compared  to  the 
previous  path  distance  (which  was  initially  infinite)  with 
the  smaller  of  the  two  being  selected.  The  tentative  shor¬ 
test  path  distance  is  then  0  +  2  =  2. 

Step  2.D,E;  The  path  distance  is  then  mapped  into  a  time 
value  of  2.  Node  2  will  now  tentatively  schedule  the  trans¬ 
mission  cf  the  update  message  "2H  at  time  2  to  all  nodes  in 
its  Update  Transmission  List.  The  message  number  indicates 
the  transmitting  nodes  identity. 
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Node  2  completes  this  action  at  time  0  since  no 


processing  time  is  assumed.  At  node  3  a  similar  process 
takes  place. 

Step  2. A;  Hode  3  deletes  node  1  from  its  Update 
Transmission  List. 

Step  2.B;  The  Update  Reception  Height  is  computed  to  be 
0  since  tie  time  of  reception  was  0. 

Step  2.C;  The  Reception  Height  is  added  to  the  reverse 
link  weight  with  the  result  of  0  +4  =4  for  the  path 

distance. 

Step  2.E,E;  Node  3  schedules  the  tentative  transmission 
of  the  message  "3"  to  nodes  2  and  4  at  time  4. 

The  network  is  then  "quiet"  until  time  2  whereupon  node 
2  sends  message  "2"  to  nodes  3  and  4.  Upon  receipt  cf  the 
message  at  time  2#  ncde  4  performs  the  following: 

Step  2. A;  Node  4  deletes  node  2  from  its  Update 
Transmission  List. 

Step  2.8;  The  Update  Reception  Height  of  the  message  is 
computed  to  be  2  since  the  time  of  reception  was  2. 

Step  2.C;  This  weight  is  added  to  the  reverse  link 
weight  with  the  result  of  2  ♦  3  =  5  for  the  path  distance. 


62 


•  A  Tjr  r  V-  J*.  /  iTw  rw  <  .  '  .  '  c 


Step  2.D;  Node  4  tentatively  schedules  the  transmission 
of  message  "4"  tc  node  3  at  time  5. 

At  node  3  the  following  action  is  occurring: 

Step  2. A;  Node  3  deletes  node  2  from  its  Update 
Transmission  List  leaving  only  node  4. 

Step  2.B;  The  Update  Reception  Weight  of  the  message  is 
computed  to  be  2  since  the  time  of  reception  was  2. 

Step  2.C;  The  Reception  Weight  is  added  to  this  link 
weight  with  the  result  of  2  ♦  1  =  3  being  the  path  distance. 
This  path  distance  is  then  compared  with  the  previous  value 
of  4.  Since  this  path  distance  is  shorter,  the  new  tenta¬ 
tive  path  distance  becomes  3. 

Step  2. D ,G ;  Node  3  then  reschedules  the  transmission  of 
the  message  "3M  to  occur  at  time  3  when  it  will  be  sent  to 
node  4. 

Again  the  clock  ticks  until  time  3  at  which  point  cede  3 
sends  Neighbor  node  4  the  message  "3".  Node  4  then  takes 
the  fcllcwing  action: 

Step  2. A;  Node  4  deletes  node  3  from  its  now  empty 
Update  Transmission  List. 

Step  2.B;  The  Update  Reception  Weight  is  computed  to  be 
3  since  the  time  of  reception  was  3. 
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Step  2.C;  This  Reception  Weight  is  added  to  the  reverse 
link  weight  resulting  in  3  ♦  1  *  4  which  is  less  than  the 
previous  value  of  5.  The  path  distance  is  then  updated  to 
the  new  value  of  4. 

Since  the  Update  Transmission  List  of  node  4  is  empty, 
additional  update  transmissions  are  not  needed.  At  termina¬ 
tion  of  the  algorithm,  the  solution  to  the  shortest  path  to 
node  1  for  each  node  is: 


Node 

2: 

Shortest 

path 

(distance  * 
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via 

node 
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4) 

was 
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node 
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From  inspection  cf  this  simple  network,  the  solution  calcu¬ 
lated  by  the  Ten  algorithm  is  seen  to  be  correct.  It  is  now 
shown  that  the  algorithm  arrives  at  a  set  of  optimal 
shortest  path  distances  from  nodes  J  to  the  destination  node 
K  for  any  connected  network. 

During  the  course  of  the  algorithm's  operation  at  seme 
time  t,  there  exists  a  set  of  tentative  path  distances, 
F  (J,  K) ,  which  have  corresponding  time  values,  T[F(J,K)], 
greater  than  t.  These  path  distances  represent  the  tenta¬ 
tive  shortest  paths  from  nodes  J  to  destination  node  X  using 


the  test  paths  computed  up  to  that  time.  As  time  passes, 
the  smallest  of  the  tentative  F(J,K),s,  say  F(J*,K)  will 
becoie  permanently  labeled  because  at  time  t  =  T[F(J*,K)]  it 
becomes  apparent  that  there  is  no  other  path  from  node  J*  to 
node  K  that  has  a  shorter  distance  than  F(J*,K).  On  one 
hand,  the  tentative  F(J,K)  *s  become  permanently  labeled  as 
time  passes;  and,  on  the  other  hand,  whenever  a  F(J,K) 
becomes  permanently  labeled  it  is  used  to  update  ether 
tentative  F(J,K)  *s.  Therefore,  at  the  termination  of  the 
algorithm,  the  F(J,K)'s  thus  obtained  are  the  distances  of 
the  optimal  shortest  paths  from  nodes  J  to  the  destination 
node  K. 


A  gseful  analogy  to  picture  the  operation  of  the  algo¬ 
rithm  is  tc  visualize  each  node  as  having  an  alarm  clock. 
Upon  reception  of  the  first  update  message  "K",  node  J  sets 
its  alarm  tc  go  off  at  time  t  =  T[F(J,K)  ].  If,  prior  tc  the 
alarm  deck  "buzzing",  node  J  receives  another  message  over 
a  different  link,  then  it  compares  the  current  alarm  setting 
with  the  newly  computed  time.  The  smallest  of  the  two  time 
settings  is  adopted,  which  in  the  analogy  equates  to  reset¬ 
ting  the  alarm  clock  tc  the  new  shorter  time.  When  time  t  = 
T[  P  { J  ,K)  ]  finally  occurs,  node  J  "wakes  up"  and  sends  its 
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own  message  MJ"  to  all  Neighbors  from  which  it  has  not  yet 
received  a  message.  The  terminology  used  in  this 
description  (i.e.  alarm  clock,  setting,  buzzer,  and  wake  up) 
is  used  throughout  the  simulation  program  to  aid  in 
visualizing  the  various  operations  performed  by  the  nodes 
for  the  algorithm. 

E.  HODIFICATIOHS  TO  IBS  TEN  ALGOBITHH 

As  described  in  Appendix  A,  the  Yen  algorithm  does  not 
compensate  for  time  delays  caused  from  the  transmission  and 
processing  of  information  and  is  not  able  to  find  simultane¬ 
ously  the  shortest  paths  to  many  destination  nodes.  Prior 
to  application  withir  the  simulation,  both  of  these  modifi¬ 
cations  were  made.  The  solution  to  the  problem  of  time 
delays  is  presented  first. 

1.  Time  Delay 

The  delay  associated  with  transmitting  information 
over  a  link  between  nodes  within  a  digital  communication 
network  involves  three  factors: 

1.  The  length  of  the  transmitted  message. 

2.  The  propagation  delay  of  the  transmission  medium. 

3.  The  message  processing  time  for  the  receiver. 
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If  at  tiie  0,  node  J  begins  sending  the  first  bit  cf 
an  N  tit  packet  aessage  to  node  K  then  at  some  later  time 
the  last  bit  of  the  aessage  will  have  been  sent.  If  R  is 
the  transaission  rate  in  bits  per  second  of  the  node  then 
this  time  will  be 

Tu  =  N  *  R 

The  first  bit  of  the  transmitted  message  will  reach  the 
receiving  ncde  after  a  delay  in  propagation  given  by 

Tp  =  L  /  V 

where  I  is  the  physical  length  of  the  link  in  meters  and  V 
is  the  velocity  cf  propagation  for  the  medium  in  meters  per 
second.  The  receiver  then  will  have  the  entire  message  at 
time  Tu  ♦  Td.  The  microprocessor  must  then  perform  the 
timing  computations  which  will  be  completed  in  the 
processing  time  Tm.  The  total  delay  from  the  time  a  node 
begins  sending  a  message  to  the  completion  of  processing  by 
the  receiving  node  is 

Td  =  Tu  +  Tp  +  Tm 

The  basic  Ter  algorithm  functions  on  the  principle 
cf  mapping  the  weight  of  a  link  into  a  time  delay  in  the 


67 


transmission  of  an  update  message.  The  mapping  function  is 
lineac  based  upon  the  constant  C.  When  delays  are  present 
in  a  network  without  proper  compensation,  link  weights  are, 
in  effect,  changed  which  can  result  in  erroneous  best  path 
calculations.  It  is  important  to  bear  in  mind  that  the 
weight  H  (I,J)  associated  with  link  (I,J)  is  specified  by  a 
commodity  which  the  network  designer  is  attempting  to  mini¬ 
mize  ever  all  possible  paths.  Physical  transmission  and 
processing  delays  may  have,  nothing  to  do  with  the  selected 
commodity  and  thus  their  effect  upon  the  algorithm's  opera¬ 
tion  must  be  removed. 

The  nature  of  the  problem  is  illustrated  using  the 
basic  network  given. is  Figure  3.2.  In  this  network  a  time 
delay,  Td,  is  associated  with  each  link  which  is  assumed  to 
be  identical  for  all  links  in  the  network.  If  node  1  origi¬ 
nates  an  update  message  then  node  3  will  eventually  receive 
this  destination  update  over  both  links  (3,2)  and  (3,1). 
Node  3  will  then  perform  two  separate  calculations  of  the 
algorithm  resulting  in  two  time  settings  related  to  the 
transmission  of  its  own  update.  The  time  setting  from  the 


update  traveling  over  link  (1,3)  is 


vv> 


Pigure  3.2  Transmission  Delay  Demonstration  network 


T  (3:1) 


Td  ♦ 


WJ3,1)^ 
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In  the  same  way,  the  tine  setting  from  updates  traveling 
ever  links  (1,2)  and  (2,3)  is  given  by 


T(3: 2: 1) 


W  (2 , 1 )  +  (1(3,2) 

2Td  +  ------ - ----- 

C 


For  a  given  selection  of  link  weights,  either  path  may  be 
the  test.  Therefore,  T(3:1)  must  be  able  to  be  greater 
than,  less  than  or  egual  to  1(3:2: 1)  based  upon  the  link 
weights  themselves  and  independant  of  transmission  delays. 
The  most  direct  means  of  removing  these  effects  is  to  let 
each  link  weight  be  compensated  individually  such  that 

w  (I,J)  *  w (I  ,J)  -  (Td  *  C) 
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This  Beans,  however,  that  the  -initial  stipulation  of  having 
all  link  weights  be  greater  than  or  equal  to  zero  must  now 
be  modified  to 

H(I,J)  >  Td  *  C 

In  implementing  this  scheme  there  are  two  alterna¬ 
tives.  The  first  is  to  establish  link  weights  such  that  all 

W  <I,J}  >  1 

which  would  mean  that 

C  *  1  /  Td 

Therefore  Step  2.C  of  the  algorithm  would  become 

F(J,K)  »  min[F(J,K)  ,  W  (J,  L)  ♦  F  (L,  K)  -1] 

The  second  alternative  (which  was  actually  used  in  the  simu¬ 
lation)  is  to  ensure  that 

W  <I,J)  >  Td 

which  meant  that 

C  =  1 

Step  2.C  then  becomes 

•> 

F  ( J,  K)  *  min[  F  (J  ,K)  ,  W(J,L)  ♦  F  (L ,  K)  -  Td] 
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The  raising  of  the  lower  bound  of  allowable  link  weights 
prevents  the  algorithm  from  scheduling  update  transmissions 
in  "negative”  or  past  time. 

Figure  3.3  depicts  the  network  used  to  show  the 
effects  that  time  delays'  have  upon  the  basic  algorithm  and 


Figure  3.3  Time  Delay  Test  Network 


then  the  modified  version.  The  time  delay  for  each  link  is 
1  second  and  C  is  set  equal  to  1.  Link  weights  are  labeled 
and  the  destination  is  node  1.  The  actions  of  both  the 
basic  and  modified  algorithms  are  summarized  in  Table  I.  By 
cbservaticn  it  is  fcund  that  the  best  path  from  node  4  to 
node  1  is  via  node  3  which  has  a  path  distance  of  6.  Note, 


however , 


that  node  4  using  the  unmodified  algorithm  arrived 


TABLE  I 

Actions  of  Easic  and  Modified  Algorithms 


! 


lime  (secs) 
0 
1 

3 

4 

6 

7 

0 

1 

2  \ 

3 

4 

5 


BASIC  ALGOBITHH 

Node  Activity 

nl  xmts  •  1*  to  n2  and  n4. 

n2  revs  1  1**  schedules  xmt  of  *2' 
at  time  =2+1=3. 

n4  revs  *  1»,  schedules  xmt  of  '4' 
at  time  *7+1=8. 

r2  xmts  '2'  to  n3. 

n3  revs  '2*,  schedules  xmt  of  '3' 
at  time  *2+4*6. 

n3  xmts  '3'  to  n4. 

n4  revs  '3'.  computes  the 
min[  8  ,  2  +  7]  *  8. 

HODIFI ED  ALGOBITHH 

nl  sends  *1'  to  n2  and  n4. 

n2  gets  *1',  schedules  xmt  of  '2' 
at  time  *  2  ♦  1  -  1  =  2. 

n4  gets  '1'r  schedules  xmt  of  '4' 
at  time  *7+  1-1=7. 

n2  send  '  2'  to  .n3. 

n3  gets  '  2'  ,  schedules  xmt  of  '3' 
at  time  =  2+3-  1=4. 

n3  sends  '3'  to  n4. 

n4  gets  '3',  computes  the 

min[  7  ,  2  +  5  -  1  ]  =  6. 

% 


at  an  incorrect  solution.  In  contrast,  the  modified  algo¬ 
rithm  compensated  fer  propagation  delays  and  computed  the 
correct  path  distances  and  best  path  next  node  at  all  nodes 


within  the  network 


In  applying  .  the  modified  algorithm,  when  all  link 
weights  are  set  to  their  minimum  allowable  values,  the 
resulting  routing  table  is  a  least  hop  one.  This  important 
result  was  used  during  the  development  of  the  link  weight 
function  in  Chapter  V.  At  this  point,  though,  one  can  begin 
to  see  if  link  weights  are  related  to  traffic  parameters  in 
some  way,  that  during  periods  of  light  activity  (when 
weights  are  small)  the  modified  algorithm  will  "automati¬ 
cally"  prcduce  least  hep  routing.  As  shown  earlier,  least 
hop  routing  is  very  effective  when  traffic  intensity  is 
light . 

2.  Multiple  Destination  Nodes 

The  second  modification  involves  enabling  the  algo¬ 
rithm  to  handle  simultaneously  the  best  path  calculations  to 
many  destination  nodes.  The  simple  message  •  K'  and  'J'  must 
be  changed  to  contain  additional  information  in  order  to 
identify  the  destination  node.  One  solution  is  that  the 
update  message  contain  both  the  originating  and  retransmit¬ 
ting  nodes  identity.  This  would  uniquely  identify  the 
update  message  for  the  receiving  node. 

Along  similar  lines  as  multiple  destination  nodes  is 
the  need  to  distinguish  consecutive  updates  originating  from 


the  sale  node.  In  crder  to  differentiate  them,  a  sequence 
number  can  be  included  in  the  update  message.  The  determi¬ 
nation  of  the  number  cf  bits  assigned  to  the  sequence  number 
would  relate  to  the  aaount  cf  differentiation  required.  If 
no  more  that  «  updates  originating  from  the  same  node  could 
be  in  transit  at  the  same  time  within  the  network,  the 
number  of  bits  for  the  sequence  number  would  be  log  li  (using 
hase  twc  logarithm) .  Using  this  method,  the  sequence 
numbers  would  continuously  cycle  from  1  to  M. 

All  network  nodes  must  also  have  the  additional 
capacity  for  keeping  account  of  multiple  update  "alarm 
clock"  sequences.  Memory  requirements  include  maintaining 
the  clock  setting  and  the  corresponding  Update  Transmission 
List  for  each  destination  node  update  which  is  in  progress, 
for  very  large  networks  this  may  be  a  considerable  require¬ 
ment.  Alternate  methods  involving  hierarchical  network 
structures  are  considered  later  in  this  chapter  as  possible 
schemes  tc  reduce  these  requirements. 

C.  CCHEUTATIONAL  EFFICIENCI 

In  the  comparison  of  shortest  path  algorithms  criterion 
which  is  often  used  for  judging  their  performance  is  the 
calculation  of  upper  bounds  cn  the  number  of  computational 


steps  each  require.  Computational  steps  refer  to  the  addi¬ 
tions,  subtractions  and  comparisons  used  during  the  execu¬ 
tion  cf  the  algorithm  by  the  node's  microprocessor.  An 
additional  criterion  related  to  distributed  algorithms 
involves  the  nature  and  frequency  of  information  which  is 
exchanged  between  nodes. 

Corresponding  tc  almost  any  shortest  path  algorithm, 
there  exists  some  special  network  structure  for  which  the 
algorithm  is  efficient.  Dreyfus  [Ref.  16]  provides  a 
comparison  of  the  computational  efficiency  of  many  shortest 
path  algorithms  using  a  test  network  in  which  every  pair  of 
nodes  is  connected  by  a  link.  In  interpreting  the  results 
it  is  considered  that  cne  algorithm  is  significantly 
superior  tc  another  when  the  computational  bounds  differ  by 
the  multiplicative  factor  involving  N ,  the  number  cf  nodes. 
When  computational  bounds  differ  only  by  a  constant  then  the 
selection  between  the  algorithms  must  be  based  cn  ether 
criterion.  Dreyfus  concludes  that  the  Dijkstra  centralized 
shortest  path  algorithm  was  most  efficient  (of  the  ones 
examined)  requiring  1/2  N*  additions  and  N*  comparisons  in 
calculating  the  shortest  paths  between  all  node  pairs.  The 
only  decentralized  algorithm  tested  was  one  by  Abram  and 
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Rhodes  (Bef.  17]  which  fared  much  worse  than  Dijkstra*s. 
The  efficiency  of  the  algorithms  by  Gallagher  and  Segall  was 
not  discussed  in  the  references. 

The  Yen  algorithm  in  determining  the  best  paths  from  all 
nodes  J  to  a  destination  node  K  in  an  N-node  complete 
network  requires  as  test 

IN- 7)  +  (N-2)  ♦  ...  ♦  1  =  1/2  N«  additions 

and  the  same  number  cf  comparisons  to  execute  the  N-1  itera¬ 
tions  of  Step  2.C  of  the  algorithm.  For  calculating  the 
test  paths  tetween  all  node  pairs,  the  previous  results  are 
multiplied  by  N  resulting  in  a  requirement  of  1/2  N3  addi¬ 
tions  and  1/2  N3  comparisons.  The  algorithm  also  requires 
at  most  1/2  N3  transmissions  of  the  simple  update  messages 
in  Step  1  and  Step  2,E  of  the  algorithm. 

This  result  concerning  the  update  transmissions  can  be 
used  to  find  the  upper  bound  on  link  utilization  due  to 
update  message  traffic  in  a  connected  N-node  network.  The 
maximum  number  of  transmissions  required  to  determine  the 
best  path  from  all  nodes  to  a  single  destination  node  is  1/2 
N. '  The  proof  can  be  shewn  using  Step  2. A  of  the  algorithm 
which  states  that  after  receiving  a  message,  node  J  deletes 
the  retransmitting  node  from  its  own  Update  Transmission 


TABLE  II 

Computational  Efficiency 

Algorithm 

Addit  ions 

Comparisons  Transmissions 

Yen 

1/2  N3 

1/2  N3 

n 

25 

CM 

V 

Abram 

1/2  N4 

1/2  N4 

1/2  N4 

Ei jkstra 

1/2  N3 

S  3 

._j 

list.  This  act  eliminates  the  possibility  of  update  looping 
upon  transmission  by  node  J .  This  means  that  for  each  pair 

cf  links  <I,J)  and  (J,I)  in  a  full  duplex  system,  only  one 

of  them  will  carry  an  update  transmission  associated  with  a 
given  destination  node.  The  total  number  of  transmissions 
in  the  network  for  a  single  destination  update  is  then  one 
half  the  number  of  links  which  for  a  fully  connected  network 
is  approximately  1/2  H*. 

The  results  of  the  computational  efficiencies  of  the 
three  algorithms  is  given  in  Table  II.  Additional  computa¬ 
tional  advantages  of  the  Ten  algorithm  include: 

1.  The  computational  effort  of  the  algorithm  is  propor¬ 
tional  to  tke  number  of  links  in  the  network. 

Therefore  the  Yen  algorithm  requires  fewer  computa¬ 
tions  in  sparse  networks  where  there  are  fewer  links. 
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2.  Unlike  Dijkstra’s  algorithm,  the  Yen  'algorithm  dees 
net  have  to  scan  fer  the  minimum  of  all  tentative 
best  path  distances  in  order  to  sort  out  the  perma¬ 
nent  best  path;  consequently ,  it  saves  computations. 

3.  Unlike  the  Abram  and  Rhodes  algorithm,  the  Yen  algo¬ 
rithm  does  not  use  a  best  path  distance  F(L,K)  to 
update  other  tentative  best  path  distances  F(J,K) 
unless  F  ( l, K )  itself  is  permanent. 

B.  APPLICATION  TO  PACKET  S  HITCHED  NETWORKS 

In  adapting  the  Yen  algorithm  to  a  packet-switched 
network,  techniques  must  be  developed  to  enable  the  algo¬ 
rithm  to  operate  as  "transparently"  as  possible  within  the 
network.  Specific  problems  relating  to  burdening  the  node’s 
microprocessor  with  routing  calculations  and  excessive  over¬ 
head  from  update  transmissions  have  to  be  avoided. 
Fortunately,  the  computational  efficiency  of  the  Yen  algo¬ 
rithm  is  very  good  and  the  only  special  hardware  requirement 
is  a  clocking  device  which  already  exists  in  the  micropro¬ 
cessor.  The  challenge,  then,  for  implementing  the  algorithm 
is  centered  in  the  fundamental  way  in  which  the  link  weight 
information  must  propagate  in  the  network. 


Per  the  Yen  algorithm  to  function  it  is  critical  that 
the  update  messages  he  transmitted  at  the  calculated  time 
setting  since  the  tine  of  transmission  is  directly  tied  to 
the  path  distance.  The  capability  for  a  node  to  be  able  to 
transmit  an  update  over  a  link  at  a  precise  time  is  crucial 
to  the  algorithm's  success. 

Problems  develop  when  at  time  t  =  T[F(J,K)  ] ,  node  J  is 
to  send  update  'J'  to  nodes  in  its  Update  Transmission  List 
and  some  links  are  busy  transmitting  message  packets.  Even 
if  update  packets  are  given  highest  priority  and  placed  at 
the  top  of  the  link  queues,  the  delays  due  to  busy  links  may 
be  tcc  great. 

There  is  another  factor  which  concerns  the  desire  to 
have  updates  propagate  throughout  the  network  as  quickly  as 
possible.  Fast  update  propagation  means  more  timely  routing 
information  upon  which  to  base  calculations.  This  can  be 
accomplished  by  proper  selection  of  the  constant  C  in  the 
algorithm.  The  propagation  speed  of  updates  through  a 
network  can  be  increased  by  letting  C  equal  its  maximum 
allowable  value.  The  limitation  on  this  upper  value  is  set 
hy  the  propagation  delay  associated  with  the  links  them¬ 
selves.  When  C  is  large  the  time  delays  computed  for  the 
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transmission  of  update  messages  will  be  their  shortest. 
Therefore  delays  due  to  updates  waiting  for  message  packet 
transmissions  will  result  in  errors  with  best  path  calcula¬ 
tions  being  even  mere  amplified.  The  solution  to  this 

problem  lies  in  the  configuration  of  the  update  packet 
itself. 

To  reduce  the  overhead  from  update  traffic,  the  length 
of  the  update  packet  should  be  kept  to  a  minimum, 
fortunately,  the  Yen  algorithm  requirement  on  information 
between  nodes  is  quite  small.  The  update  message  in  its 
basic  ferm  contains  the  identity  of  the  destination  and 
retransmitting  nodes.  The  update  also  requires  a  preamble 
which  identifies  it  as  being  an  update  packet.  By  selecting 
a  specific  form  for  the  preamble,  the  answer  to  the  problem 
of  transmitting  an  update  over  a  link  which  is  husy  sending 
a  message  packet  is  found. 

1.  0 f date  Insertion  Technique 

While  a  message  packet  is  being  transmitted  an 
update  packet  could  be  transmitted  at  its  precise  time  if 
there  was  a  means  of  inserting  the  update  into  the  bit 
stream  of  the  message  packet.  The  receiving  node  must  then 
be  able  tc  distinguish  this  inserted  update  from  the  message 
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packet,  remove  the  update  packet  and  then  reassemble  the 
message  packet.  Though  scunding  like  quite  a  complex 
program  for  the  node’s  microprocessor  to  handle,  the  imple¬ 
mentation  is  straightforward. 

let  the  preamble  of  the  update  packet  be  a  specific 
bit  pattern  of  length  L  which  is  called  a  reserved  pattern 
or  symbol.  Hamming  [Eef.  18]  illustrates  the  concept  of 
reserved  symbols  by  the  quotation  marks  in  FORTRAN  program¬ 
ming  which  are  used  to.  distinguish  comments  from  actual 
operating  cede.  The  receiving  node,  knowing  the  reserved 
pattern,  simple  scans  the  incoming  bit  stream  and  upon 
detecting  this  pattern,  removes  these  L  bits  and  the 
following  0  bits  which*  make  up  the  entire  update  packet. 

The  problem  is  not  completely  solved  for  if  by 
chance  the  reserved  pattern  occurs  in  a  message  not 
containing  an  update  packet  then  the  node  would  respond  to 
the  reserved  pattern  which  is  undesirable.  The  solution  is 
to  add  an  extra  bit  after  the  L  bit  reserved  pattern  with  a 
1  signifying  an  actual  update  packet  and  a  0  otherwise.  The 
transmitting  node  is  new  required  to  observe  the  bit  stream 
of  outgoing  message  packets  and  when  detecting  the  reserved 
pattern,  insert  a  0  as  the  following  bit.  If  the  reserved 


Figure  3.4  Opiate  Packet  configuration 


pattern  happens  to  appear  often  in  the  course  of  message  bit 
streams  then  a  good  deal  of  channel  capacity  will  be  wasted. 
Figure  3.4  shows  how  the  components  of  the  update  packet  are 
configured. 

The  probability  of  a  reserved  pattern  occurring  can 
be  reduced  by  increasing  its  length  L.  However,  as  L 
increases,  the  total  update  packet  length  grows  and  more 
available  channel  capacity  is  used  in  update  overhead.  In 
examining  the  trade-cffs  involved  in  selecting  the  length  of 
the  pattern,  the  lir.k  utilization  using  the  insertion  tech¬ 
nique  is  examined. 

a.  Overhead  from  Insertion  Technique 

The  insertion  technique  "costs"  L  ♦  1  bits  per 
update  packet  and  1  bit  for  each  occurrence  of  the  reserved 


pattern  in  a  message  packet.  Since  the  data  transmission 
rate  is  known,  the  total  link  utilization  due  to  this  method 
is 

0TIL[in  serts  ]  =  [Nu(L  +1)  ♦  Hn(1)]  /  B 

where  Nu  =  Average  number  of  updates  transmitted  per 
link  per  second. 

Nm  *  Average  number  of  occurrences  of  the 

reserved  pattern  in  messages  per  link  per 
second . 

H  =  Data  transmission  rate  (bits  per  second) 


The  upper  bound  on  update  link  utilization  can  be  directly 
computed  frcm  the  knowledge  of  the  number  of  nodes  ir.  the 
network  and  the  update  interval.  The  update  interval  corre¬ 
sponds  tc  the  average  amount  of  time  between  consecutive 
updates  being  generated  by  a  single  node.  If  each  of  the  N 
nodes  in  the  network  generates  a  destination  update  every  T 
seconds  then  Nu  will  be 

Nu  =  N  /  2T 
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The  next  effect  examined  is  that  of  the  reserved 
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necessary  to  determine  the  number  of  occurences, 
average,  of  the  reserved  pattern  which  appear  in-  a  message 
packet.  The  problem  is  approached  by  first  modeling  the 

message  packet  as  a  random  binary  sequence  of  length  H.  If 
it  is  assumed  that  the  message  is  the  same  length  as  the 
reserved  pattern  then  the  probability  of  the  pattern  and  the 
message  being  the  same  is 

Ercb[  pattern  occurring]  =  1  /  2**L 

In  the  case  where  the  message  is  not  the  same  size  as  the  • 
reserved  pattern  then  a  binomial  random  variable  is  used 
with  the  following  definitions: 

F  =  The  probability  of  the  reserved  pattern 
occuring  in  a  sequence  of  length  L. 

n  =  The  number  of  possible  L  length  sequences 
in  a  message  of  length  M. 

X  =  The  number  of  times  the  reserved  pattern 
occurs . 

F[  X  =  k  ]  =  The  probability  that  the  reserved 

pattern  occurs  k  times. 

From  the  first  case  of  equal  length  patterns  and  messages, 
the  value  of  p  is 

p  =  1  /  2**L 
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The  value  of  n  can  be  found  by  adding  one  bit  at  a  time  tc  a 
message  packet  which  initially  has  length  a  equal  to  L  and 
determining  how  many  possible  reserved  pattern  sequences 
could  occur.  If  H  equalled  L  +  1,  then  one  pattern  could 
cccur  starting  at  either  the  first  or  second  bit.  However, 
it  is  cbvious  that  two  patterns  could  not  coexist.  A 
message  length  of  2L  wculd  have  to  exist  before  two  patterns 
could  be  found.  This  result  is  generalized  such  that 

n  =  a  /  L 


The  existence  of  "overlapping”  reserved  patterns 
is  impossible  based  upon  the  receiver's  recognition  tech¬ 
nique  for  detecting  reserved  patterns.  The  receiver  views  L 
tits  at  a  time,  and  upon  finding  a  reserved  pattern,  looks 
at  the  following  signaling  bit  and  takes  the  appropriate 
action.  In  the  case  of  no  update  packet  present,  the 
receiver  strips  off  the  signaling  bit  and  continues  to  check 
the  tit  stream  starting  with  the  next  message  bit.  This 
precludes  the  possibility  of  overlapping  reserved  patterns. 

The  probability  of  the  reserved  pattern  occur¬ 
ring  k  times  is  then  a  binomial  random  variable  in  which 


EC  X  -  k  ]  =  : 7 ------- 7  (P**M  C  (1  -  p)**(n  -  k)  ] 

K  X  (H  •  K)  I 


85 


The  expected  number  of  occurrences  is  given  by 


EC  X  j  =  np 

If  the  average  number  of  message  packets  transmitted  per 
link  per  second  is  P ,  then 

PH 

US  =  - 

L  (2**L) 

Substituting  the  values  of  Nu  and  Nm  into  the  utilization 
formula  yeilds 


N  (L  ♦  1 )  PM 

DTILf  in  serts  ]  =  -  ♦  - 

2TR  LR  (2 **L) 


This  result  indicates  that  the  highest  overhead  will  be  due 
to  the  update  packets  themselves  when  a  reserved  packet  is 
selected  which  is  lcng  enough  so  that  the  exponential  term 
in  the  denominator  becomes  large. 

E.  A  HIERARCHICAL  VERSION 

The  need  for  reducing  the  size  of  routing  tables  and  the 
overhead  frcm  node  update  transmissions  can  be  met  by  modi¬ 
fying  the  Yen  algorithm  to  be  able  to  function  in  an  hier¬ 
archical  form.  In  presenting  the  modifications  to  the  basic 
algorithm,  the  requirements  necessary  for  a  hierarchical 
version  tc  function  are  identified. 
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When  using  a  hierarchical  scheme,  the  network  is  divided 
into  regions  of  nodes;  if  additional  levels  are  needed, 
these  regions  may  in  turn  be  grouped  into  clusters.  The 
number  of  levels  is  in  no  way  limited  to  two,  depending  to  a 
large  extent  upon  the  total  network  size,  but  this  illus¬ 
trates  the  point.  The  terms  "group"  and  "family"  will  be 
used  to  refer  to  the  two  respective  levels  which  is  in 
keeping  with  some  of  the  prior  work  in  this  area  (Bef.  19]. 

Pouting  table  size  is  therefore  reduced  since  individual 
nodes  no  longer  have  to  keep  entries  on  each  node  within  the 
entire  network.  Nodes  only  keep  "node"  entries  in  their 
routing  tables  to  nodes  within  their  same  group.  To  route 
messages  to  nodes  outside  their  group,  but  within  the  same 
family,  "group"  entries  are  maintained  so  that  each  node 
knows  the  best  path  to  groups  within  the  family.  Finally 
"family"  entries  are  kept  so  that  nodes  know  the  routes  to 
families  outside  their  own. 

The  Ten  algorithi  functions  successfully  because  of  the 
implicit  ability  of  a  node  to  send  its  destination  update  to 
its  neighbor  nodes  at  the  same  time.  In  this  manner,  the 
link  weight  information  which  is  directly  related  to  update 
transmission  time  is  accurately  disseminated.  For  the  Yen 
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algorithm  tc  function  in  a  hierarchical  structure,  then, 
demands  that  a  group  cf  nodes  be  able  to  transmit  its  grcup 
destination  update  tc  all  of  its  neighbor  nodes  at  the  same 
time.  This,  of  course,  applies  to  each  hierarchical  level. 

The  key  tc  applying  the  basic  algorithm  in  this  structure  is 
to  develop  a  means  whereby  a  grouping  of  individual  nodes 
can  act  as  a  single  ‘super*  node.  By  using  a  grcup 
"warning"  message,  adequate  coordination  can  be  accomplished 
so  that  this  is  possible. 

1  •  Warning  Messages 

This  warning  message  could  originate  from  any  node 
within  the  basic  group.  The  warning  contains  information  » 
identifying  its  nature  and  the  future  time  at  which  the 
group  update  message  is  to  be  sent.  This  future  time 
(called  the  "firing  time")  would  be  far  enough  in  the  future 
as  tc  ensure  that  all  nodes  within  the  basic  group  had 
received  the  warning  prior  to  firing  time.  Each  node  knows 
the  identity  of  its  neighbor  nodes  and  therefore  this 
warning  would  only  be  transmitted  to  nodes  in  the  basic 
group. 

The  means  of  disseminating  warning  messages  within 
the  group  could  be  by  a  simple  flooding  scheme.  Upon 


reception  of  the  warning  message,  the  node  is  "cocked”  and 
ready  to  fire  the  update.  When  the  firing  time  occurred, 
nodes  in  the  group  would  only  transmit  the  group  update 
message  to  nodes  outside  of  the  basic  group.  Since  all  of 
these  "herder"  nodes  of  the  group  would  fire  the  update  to 
outside  nodes  at  the  same  time,  the  net  effect  would  be  as 
if  a  single  "group-sized"  node  had  originated  the  update 
message.  Figure  3.5  depicts  the  actions  that  occur  during 
this  sequence  of  events. 

The  algorithm  would  not  change  except  that  the  orig¬ 
inator  of  the  update  would  be  the  group  identifier.  For  a 
two  level  hierarchy,  updates  would  originate  from  nedes, 
groups  or  families  and  warning  messages  would  be  of  two 
types,  either  greup  cr  family.  . 

2.  Crioinat inc  Warning  Messages 

In  using  the  warning  message  concept,  a  methed  of 
determining  how  they  will  be  originated  for  the  group  is 
required.  The  key  consideration  in  the  selection  of  the 
method  is  whether  a  single  nede  within  a  group  should  be 
responsible  for  originating  the  warnings  or  if  this  function 
is  tc  be  distributed  amengst  all  nodes  in  the  group.  The 


first  method 


looked  at  was  a  distributed  scheme  in  an 


attempt  to  minimize  the  use  of  centralized  control 
functions. 

This  proposed  method  was  based  upon  having  each  ncde 
originate  its  own  group  warning  message  on  a  regular  basis. 
The  time  interval  between  messages  could  be  a  uniformly 
random  amount  with  a  prescribed  average  value,  perhaps 
related  to  a  multiple  of  the  node  update  interval.  An 
anticipated  problem  with  this  approach  is  the  difficulty  in 
maintaining  acceptable  "spacing"  in  time  between  warning 
messages  which  originate  from  many  nodes.  Situations  could 
develop  where  all  warning  messages  occur  within  a  small  time 
interval,  ^followed  by  a  relatively  long  period  of  time  where 
none  are  originated.  This  '‘bunching"  and  "spreading"  of 
update  transmissions  can  cause  poor  routing  information  and 
degraded  network  performance. 

A  solution  to  this  problem  is  to  have  a  single  ncde 
within  a  group  be  the  originator  of  warning  messages  at  any 
given  time.  With  this  method,  the  problem  of  poorly 
distributed  group  update  messages  in  time  is  eliminated,  but 
now  the  network  is  subject  to  the  vulnerabilites  which  any 
form  of  centralized  control  introduce.  If  the  node  gener¬ 
ating  these  group  warnings  fails,  then  the  network  will 


suffer.  Addit  icnally  there  is  the  difficulty  in  selecting 
which  node  is  to  be  the  "leader". 

in  algorithm  is  provided  in  Appendix  B  which  gives  a 
neans  cf  determining  the  single  node  which  will  originate 
the  group  updates  and  a  way  in  which  "Successor"  nodes  can 
be  chcsen  to  replace  fallen  leaders.  It  is  based  on  the  use 
cf  a  timer  which  is  "set"  when  a  node  receives  a  warning 
message.  The  timer's  setting  is  greater  than  the  maximum 
interval  between  ccrsecutive  warning  messages  plus  the 
maximum  propagation  cf  such  messages  throughout  the  group. 
If  the  node's  timer  runs  out  prior  to  the  arrival  of  another 
warning  message  then  the  node  concludes  that  the  leader  has 
failed.  The  action  taken  by  the  node  is  the  origination  cf 
its  own  "Successor"  message  which  notifies  other  nodes  that 
it  is  now  competing  for  the  function  of  leader.-  Provision 
is  made  such  that  oily  one  successor  is  selected  if  indeed 
the  previous  leader  had  failed. 

3.  Synchronizing  On  it  Update  Transmissions 

a  possible  picblem  with  the  hierarchical  version  of 
the  Yen  algorithm  is  the  overhead  associated  with  achieving 
simultaneous  update  transmissions  by  all  nodes  of  a  group  or 
family.  It  was  mentioned  before  that  to  disseminate  the 


warning  message,  a  flooding  technique  may  have  to  te  used. 
As  discussed  in  Chapter  II,  flooding  can  cause  significant 
message  duplication  and  excessive  overhead.  Another  condi¬ 
tion  that  exists  is  that  the  only  nodes  which  actually 
transmit  the  group  update  message  are  those  on  borders  which 
have  neighbors  outside  the  basic  group.  If  these  border 
nodes,  then,  knew  cn  their  own  when  to  "fire"  the  update 
messages  then  a  substantial  reduction  in  overhead  could  be 
achieved. 

Ibe  proposed  solution  to  this  problem  is  best  illus¬ 
trated  by  means  of  a  musical  analogy.  A  node  can  be  likened 
to  a  musician  in  a  band  where  the  band  is  the  basic  group  or 
family.  Under  the  current  warning  message  scheme  the  nodes 
are  directed  to  fire  the  update  at  a  specified  time.  This 
is  similar  to  a  band  without  sheet  music  being  directed  to 
play  a  scng  one  note  at  a  time.  A  more  efficient  method 
would  te  tc  provide  each  musician  with  his  own  ccoy  of  the 
song.  Now  the  director  (i.e.  leader  node)  only  has  to 
ensure  that  the  band  members  begin  playing  at  the  same  time. 
He  must  also  periodically  wave  his  baton  to  ensure  that  the 
tempo  is  maintained. 


A  simple  pattern  which  each  node  within  a  group 
could  fellow  would  te  setting  a  fixed  interval  between 


consecutive  update  generations.  For  example,  if  the  resyn¬ 
chronization  time  was  15.8  seconds  and  the  agreed  upon  time 
interval  was  2  seconds,  then  nodes  would  transmit  their 
group  cpdates  at  times  of  15.8,  17.8,  19.8  and  so  on.  For 
many  applications  this  simple  scheme  may  be  suitable. 
However,  if  highly  repetitive  transmissions  are  not  desire- 
able,  then  a  pseudo-random  sequence  may  be  used. 

In  order  to  generate  a  pseudo-random  sequence  of 
firing  times  for  the  unit  update  messages,  a  concept  from 
spread  spectrum  communication  systems  was  utilized.  Such 
systems  often  employ  feedback  shift  registers  (FSR)  to 
generate  the  .pseudcncise  (PS)  binary  sequences  which  are 
modulated  by  the  data  bits. 

The  configuration  of  a  three  stage  FSR  is  shown  in 
Figure  3.6.  When  clocked,  a  K.-stage  FSR  produces  a  PR 
sequence  of  length  2**K  -  1  before  repeating  [Ref.  20]. 

Even  when  using  a  small  FSR,  then,  one  can  produce  a  rela¬ 
tively  leng  sequence.  Some  Direct  Spreading  spread  spectrum 
(DSSS)  systems  use  the  FSR  in  this  manner. 
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Figure  3.6  Feedback  Shift  Begister:  DSSS  Configuration 


Tc  produce  tie  pseudo-random  firing  times,  however, 
another  ccn figuration  of  the  FSB  is  proposed.  This  partic¬ 
ular  method  is  sometimes  employed  in  Frequency  Hopping 
spread  spectrum  (FHSS)  systems.  Note  that  in  Figure  3.7  the 
output  is  from  taps  taken  off  of  all  FSR  stages.  The  output 
sequence  frca  this  configuration  is  given  in  Table  III. 
This  K  tit  binary  "time"  value  will  then  hop  amongst  all 
integers  between  1  and  2**K  -  1.  The  sequence  of  heps  will 

m 

appear  randeni,  but  cf  course  is  predictable  if  one  has  the 
knowledge  cf  the  FSB  conf igurement ,  the  initial  "value" 
which  the  FSR  contains,  and  the  start  time  and  frequency  of 
the  clock. 

Since  the  K  bit  time  number  takes  on  all  values 
between  1  and  2**K  -  1  during  a  complete  sequence. 
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Figure  3.7  Feedback  Shift  aegister:  FBSS  Configuration 
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"average”  value  is  simply  the  mrdpoint  of  this  range. 
Therefore,  to  produce  a  particular  average  time  between  unit 
update  generations,  cne  could  include  a  constant  term  or  a 


scaling  multiplier  such  that  the  FSR  numbers  would  map  into 
the  appropriate  time  range. 


In  use  the  nodes  would  receive  the  ^synchronization 

time  and  then  "clock"  the  FSR  at  the  time  of  firing.  The 

value  received  wculd  correspond  to  the  time  interval  before 
the  next  firing  were  to  occur.  The  process  would  continue 
in  this  manner  with  a  new  firing  time  being  calculated 
directly  after  a  unit  update  is  sent. 

The  reduction  in  overhead  between  this  method  and 
the  previous  one  relates  tc  the  ratio  of  the  average 

interval  between  updates  to  the  average  interval  before 
resynchrcnization  is  needed.  As  an  example  if  the  average 
group  update  interval  had  been  1  second  and  if  the  time 

before  resynchronization  was  needed  for  the  pseudo-random 
time  sequence  was  20  seconds,  the  required  overhead  due  to 
warning  messages  would  be  reduced  by  a  factor  of  20. 
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If.  KTSOBK  MODELING  AND  SIMULATION 


Numerous  techniques  have  been  applied  to  the  design  and 
study  of  packet  transport  networks.  Mathematical  tools  to 
include  fccth  models  of  queues  and  networks  of  queues  have 
teen  used  tc  predict  the  behavior  of  packet  systems  with  a 
high  degree  of  success.  Many  heuristic  techniques  have  also 
teen  developed  in  the  quest  to  find  the  optimum  structure 
and  operating  methods  of  a  system.  Work  of  this  nature  has 
teen  accceplished  in  areas  such  as  network  topology  design, 
link  capacity  selection  and  routing  algorithms. 

Analytical  techniques  at  times  cannot  be  used  when  the 
theory  is  unable  to  deal  with  some  of  the  "real"  properties 
of  packet  networks  such  as  state  dependent  transition  prob¬ 
abilities  and  correlations  between  interarrival  times  and 
service  time  requirements  [Bef.  21].  Simulation  then 
becomes  a  frequently  used  technique  to  gain  useful  insights, 
and  in  fact  most  majcr  systems,  prior  to  construction,  were 
first  studied  in  this  manner. 

Basically,  simulation  has  two  main  purposes:  a)  the 
performance  evaluation  of  network  protocols  that  are  analyt¬ 
ically  intractable,  and  b)  the  validation  of  analytical 


■odels  based  upon  simplifying  assumptions  [Ref.  21]. 
However,  these  purposes  can  only  be  achieved  if  the  simula¬ 
tion  model  itself  is  valid,  and  techniques  are  required 
which  can  be  used  to  guarantee  the  validity  of  the  model. 

This  research  involved  an  application  of  simulation  for 
the  purpose  of  evaluating  a  network  routing  protocol.  The 
approach  used  to  verify  that  a  SIHSCRIPT  program  of  3500 
lines  actually  modeled  the  system  in  question  was  to  use  an 
analytical  mcdel  and  compare  the  results  when  the  program 
parameters  were  set  to  correspond.  If  the  simulation 
produces  results  which  agree  with  that  of  the  analytical 
model,  then  one  is  inclined  to  believe  that  the  results 
obtained  when  other  program  parameters  are  used  will  also  be 
valid. 

k.  ANALYTICAL  TECHNIQUES  INVOLVING  QUEUING  THEORY 

In  developing  mathematical  methods  for  analyzing  complex 
packet- switched  networks,  queuing  theory  has  been  widely 
applied  with  many  results  being  developed  that  give  insight 
to  a  variety  of  problems.  The  simplest  queuing  model  is 
that  cf  a  single  server  queue.  Single  server  queues  are 
categorized  according  to  their  interarrival  time  and  service 
distributions.  These  categories  are  often  designated  using 


a  Let  ter /let  ter /Humber,  such  as  M/M/1  or  M/G/1,  where  the 
first  letter  denotes  the  interarrival  time  distribution,  the 
second  letter  the  service  time  distribution  and  the  third 
element  the  number  cf  servers  in  the  system.  Standard 

letters  used  are  M  -  exponential,  D  -  fixed  and  G  - 
general. 

Many  formulations  have  been  developed  for  single  server 
queue  systems.  Those  which  are  related  to  finding  the 
average  number  of  customers  in  the  system  are  focused  upon 
in  this  work.  This  particular  statistic  was  chosen  based 
upon  selecting  the  ere  quantity  from  many  elements  which 
most  accurately  described  the  status  of  the  network  at  any 
given  time  during  a  simulation  run.  The  details  behind  this 
explanation  relate  tc  the  actual  simulation  program  itself 
and  are  presented  in  Chapter  V. 

1  •  little  f  s  Result 

little’s  Result  [Ref.  22]  is  a  basic  formula  which 
states  that  for  a  steady  state  queuing  process 


E[n] 


XT 


where  E(n]  3  expected  number  of  customers 

is  the  system; 

X  *  average  customer  arrival  rate; 

T  =  average  time  customer  spends 
in  system. 

This  result  is  widely  applicable  since  the  formal  proof 
makes  no  assumptions  about  the  arrival  process  distribution, 
the  service  time  distribution,  the  number  of  servers,  nor 
the  service  disciplire  which  may  be  f irst-come-f irst-serve, 
last-come-f irst-serve,  etc.  The  system  in  question  can  also 
be  a  network  of  queues  and  the  M/M/1  hypothesis  doesn't  have 
to  be  invoked,  so  that  the  theorem  is  quite  broad  in  its 
application.  Using  little's  Hesult,  an  entire  network  can 
be  enclosed  in  a  "black  box",  and  as  long  as  the  arrival 
rates  are  known  and  the  network  is  in  steady  state,  then  by 
determining  the  average  number  of  customers  (or  packets)  in 
the  system  one  can  calculate  the  average  transit  time  for  a 
packet.  This  simple  technique  allows  the  comparison  of 
Simula  lien  results  with  those  obtained  analytically  using 
Little's  Result  in  erder  to  verify  the  "behavior"  of  the 
simulation.  This  technique  was  utilized  during  the  simula¬ 
tion  program  test  phases  with  results  that  agreed  very  well 
with  those  obtained  using  Little's  Result. 
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2.  Pcllaczek-Khinchin  Formula 


A  second  foriula  useful  in  network  analysis  is  based 
upon  the  Pcllaczek-Khinchin  formula  for  finding  the  mean 
number  of  messages  in  an  H/G/1  queuing  system  (fief.  23]. 
The  B/G/1  system  involves  a  general  service  time  distribu¬ 
tion  which  implies  that  messages  may  have  non-expbr.entially 
distributed  lengths.  The  P-K  result  is  given  by 


E(  n]  * 


P  ♦  P 2 


1  ♦  Cb2 

2  o~-7) 


where  "P"  is  the  traffic  intensity  and  is  defined  as  U  p 
with  "X"  again  being  the  arrival  rate  and  ”y”  denoting  the 
service  rate.  Cb  is  the  ratio  of  the  standard  deviation  to 
the  mean  of  the  service  time  distribution  and  is  defined  as 
ab/  b  •  This  formula  shows  that  if  two  service  time  distri¬ 
butions  have  equal  means,  the  one  with  the  larger  standard 
deviation  will  produce  a  longer  waiting  time.  For  the  fl/H/1 
queue,  Ct  »  1  and  the  expression  for  E[  n  ]  reduces  to 


E(n]  = 


P 


1  -  P 


The  use  of  the  term  ’’customer”  and  ’’service  time” 
are  used  in  illustrating  queueing  models;  of  course,  in  a 
communications  network  the  customers  are  the  message  packets 
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and  the  service  rate  is  the  capacity  of  the  channel  in 
packets  per  second. 

The  P-K  formula  applies  to  message  length  statistics 
which  are  continuously  distributed  but  a  more  realistic 
assumption  is  that  these  message  lengths  are  discrete  in 
nature#  being  made  up  of  a  number  of  packets.  Studies  have 
shown  for  fccth  long  (15  to  30  minutes)  and  short  (1  to  2 
minutes)  holding-time  connections  in  packet  communications 
systems#  that  the  number  of  packets  per  message  are  geome¬ 
trically  distributed  £Ref •  25  ].  A  geometric  distribution 
means  that  the  probability  of  a  message  being  one  packet  in 
length  is  given  by  seme  number  p  <  1,  the  probability  of  two 
packets  is  pg  with  q  *  1  -  p,  the  probability  of  thre« 
packets  is  pq2  and  so  on.  The  probability  of  a  message 
being  k  packets  long  is 

E[X  =  k]  =  P(q**  (k- 1)  )  #  k  *  1#  2#... 

The  discrete  fora  of  the  P-K  formula  is  given  as 
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where  E[L]  *  the  average  number  of  packets 

in  the  system; 

pp  =  the  average  number  of  packets 

entering  the  system  in  D  seconds; 

ap2  =  the  variance  of  the  packets 

entering  the  system  in  D  seconds. 

These  parameters  refer  to  packet  arrivals  in  a  fixed  service 
interval  D.  The  value  of  D  is  related  to  the  link  capacity 
"C"  ty 


C  =  1  /  D 


which  is  in  packets  per  second.  The  term  yp  is  the  sane  as 
the  traffic  intensity  parameter  since  it  is  the  ratio  of  the 
average  traffic  rate  into  the  system  to  the  system  transmis¬ 
sion  capacity.  Therefore  p  is  the  average  number  of  packets 
arriving  in  D  seconds  or  just  up  .  To  find  the  arrival 
statistics  cf  the  packets  entering  the  system  (  Vp  and  <jp2)  , 
the  Fcisscr  distribution  of  message  arrivals  must  be 
combined  with  the  geometric  distribution  of  message  lengths 
in  packets. 

Fcr  a  geometric  distribution,  the  average  number  of 
packets  per  message  is  given  by 


E(X]  =  1  /  p 
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and  the  variance  by 


*  TJ  /  P*  • 


From  Pcisson  message  arrival  statistics  we  have 


B£H]  =  am2  = 


Therefore  if  P  is  the  number  of  packets  received  in  D 
seconds  then 


E£P]  *  yp  =  E[  X  ]E(  H  ]  =  X  D  /  p. 

The  variance  of  P  is  fcund  to  be 

ap  2  *  (E[M]ax2)  ♦  <am2  E*[X]) 

*  <  *  D<1  ♦  q))  /  p2 

Eeplacing  these  expressions  for  Up  and  a2,  the  expression 
for  the  average  number  of  packets  in  the  system  then  becomes 

XD  <  XD(1  ♦  a))  /  p2 

ECU]  * -  ♦  - - -- 

2p  2  (1  -  X  D/p) 

As  a  check  assume  that  all  messages  are  one  packet  in 
length,  in  which  case  p  =  1  and  therefore 


E[L] 


_ X  D _ 

2(1  ”xD)" 


(1  -  ^ D/2) 

1  -  X  D 


Now  ccmpare  this  with  the  continuous  formulation  using  Cb  = 
0,  whereby 
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Both  results  are  equivalent  since  when  all  messages  are  of 
fixed  length  equal  tc  one  packet,  the  number  of  messages 
stored  must  be  the  same  as  the  number  of  packets  stored. 

The  importance  of  this  formulation  is  that  the  vari¬ 
ance  cr  spread  in  the  number  of  packets  arriving  increases 
as  the  average  message  length  increases.  This  means  that 
for  a  fixed  traffic  intensity,  the  message  arrival  rate  x 
must  decrease  as  1/p  increases  to  keep  the  average  number  of 
packets  yp  =  p  fixed.  However,  this  increase  in  variance 
means  an  increase  in  the  probability  that  longer  messages 
will  arrive  and  hence  the  average  number  of  packets  in  the 
system  must  increase .  This  result  proved  very  important  in 
studying  the  behavior  of  the  routing  algorithm  when  using 
geometrically  distributed  message  lengths. 

little's  Result  and  the  P-K  formula  were  the  primary 
analytical  tools  utilized  in  determining  whether  the  simula¬ 
tion  program  was  operating  correctly.  Statistics  obtained 
during  program  runs  were  checked  by  direct  application  of 
these  formulas. 
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B.  BOTES  GB  SIHSCRIEI  II. 5 


SIHSCBIET  II. 5  is  a  discrete-event  simulation  program¬ 
ming  language  which  is  designed  specifically  for  modeling 
systems  whose  state  is  deemed  to  change  instantaneously  at 
discrete  points  in  time,  rather  than  continuously.  Ihe 
discrete  nature  of  packet -switched  networks  make  this  an 
excellent  language  for  construction  of  the  model.  Scire  of 
the  unique  features  and  general  characteristics  of  SIHSCBIPT 
II. 5  which  made  it  a  particularly  desirable  choice  for  this 
research  are  examined  in  this  section.  These  descriptions 
are  aimed  primarily  at  giving  the  reader  unfamiliar  with  the 
language  some  insight  into  why  the  program  was  structured  in 
the  manner  selected  without  having  to  assimilate  the  entire 
program. 

As  a  convenience  in  understanding  the  following  descrip¬ 
tions,  terms  appearing  in  ALL. CAPITAL  letters  with  seper- 
ating  periods  are  the  actual  variable  names  used  within  the 
program.  In  this  way  readers  wishing  to  correlate  the  over¬ 
view  information  with  the  actual  program  code  may  do  so. 

1.  Entities  and  Attributes 

An  entity  is  a  structured  data  item  which  represents 

» 

some  element  of  a  modeled  system.  It  is  like  a  subscripted 


107 


.  *r,  »*.  •’ 
.(.in  *  -  • . 


.v  •• 


variable  in  that  .it  may  represent  more  that  one  value. 
These  values  are  termed  attributes  of  the  entity  and  when 
assigned  specific  values,  they  define  a  particular  configu¬ 
ration  or  state  of  the  entity.  The  important  point,  though, 
is  that  these  attributes  are  referenced  by  name  rather  than 
by  subscript  which  enhances  readability  and  modeling.  For 
example,  one  can  create  an  entity  called  a  PACKET  which  has 
such  attributes  as  BEGIN. TI HE  and  OEST. NODE.  The  value  of 
BEGIN. TIME  is  referred  to  by  BEGIN.  TIME (PACKET) ,  which  is 
more  readable  than  using  a  multidimensional  array  with 
numerous  subscripts. 

Entities  also  may  be  either  permanent  or  temporary. 
All  permanent  entities  must  be  "created"  at  the  same  time 
and  thus  their  total  number  must  be  known.  This  fact  makes 
this  data  structure  ideal  for  modeling  the  network  nodes. 
Temporary  entities,  cn  the  ether  hand,  may  be  created  when 
needed  and  destroyed  when  no  longer  needed.  By  destroying 
temporary  entities  which  are  no  longer  needed,  significant 
savings  in  memory  can  be  achieved.  Messages,  therefore, 
were  modeled  as  temporary  entities. 


The  structuring  of  related  data  elements  by  means  of 
sets  proved  to  be  an  extremely  powerful  concept  and  was  thus 
used  extensively  in  the  model.  This  single  concept  is  by 
far  the  mcst  important  in  understanding  the  development  of 
the  network  model  and  provided  a  means  to  produce  an  "under¬ 
standable”  simulation  program. 

Cne  of  the  major  goals  of  this  particular  research 
was  to  write  a  "driver"  packet-switched'  communications  simu¬ 
lation  program.  This  meant  that  the  program  had  to  function 
efficiently,  be  modular  in  structure  for  ease  of  modifica¬ 
tion,  and  above  all  else  be  conceptually  understandable  to 
ethers  continuing  in  this  area  of  research.  In  reviewing 
simulation  programs  by  other .  authors ,  it  is  apparent  that 
the  use  of  multidimensional  array  data  structures  with  their 
numerous  subscripts  in  modeling  network  activities  and 
components  produces  programs  which  are  extremely  difficult 
to  follow.  One  simply  becomes  lost  in  the  indexes  when 
trying  to  trace  program  logic. 

The  answer  to  the  problem  for  this  author  lay  in  the 

use  of  sets.  It  was  soon  apparent  that  having  a  background 

* 

steeped  in  FORTRAN  array  structures  caused  inertia  which  had 


to  be  overcome  in  order  to  find  a  better  way  of  caking  a 
simulation.  The  results,  though,  of  using  the  set  structure 
method  seem  to  have  proved  successful,  in  that  another 
thesis  student  was  able  to  utilize  this  network  simulation 
program  as  the  basic  structure  for  modeling  another  routing 
protocol  [Hef.  24]. 

Sets  are  organized  collections  of  entities.  Sets 
are  similar  to  arrays  in  that  each  of  the  entity  elements  of 
which  the  set  is  composed  may  be  identified  and  manipulated. 
However,  '  in  contrast  to  the  static  structuring  imposed  on 
array  elements,  the  organization  of  entities  in  sets  may  be 
dynamic  and  changeable.  An  entity  may  own  a  set  of  ether 
entities.  In  our  model  a  LINK  owns  a  QUEUE  in  which  PACKETS 
can  be  "filed”  or  "removed".  Sets  can  be  searched  to  see  if 
a  particular  entity  is  currently  present,  and  may  also  be 
ordered  automatically  based  upon  such  criteria  as  first-in- 
first-out  or  last-in -first-out .  A  final  comment  concerning 
sets  is  that  the  number  of  entities  in  a  set  at  any  time  is 
contained  in  a  program  variable.  In  the  previous  case,  the 
number  of  EACKETs  in  the  QUEUE  would  be  N. QUEUE.  This 
feature  was  used  extensively  in  gathering  statistical  infor¬ 
mation  during  a  simulation  run. 


3 •  Statistical  Analysis 

The  principal  outputs  of  simulation  experiments  are 
statistical  measurements.  In  reviewing  other  simulation 
programs,  it  was  ncted  that  often-times  statements  were 
•scattered  throughout  the  program  to  collect  information  with 
special  summary  routines  written  to  print  it  out  at  the  end. 
Aside  from  being  tedious  and  time-consuming  to  produce, 
these  data  collection  and  analysis  statements  clutter  the 
operating  logic  of  a  program. 

However,  SIHSCBIPT  II. 5  has  two  statements, 
ACC OMUL ATE  and  TALLY  which  virtually  eliminate  this  kind  of 
’•book-keeping** .  ACCUMULATE  was  used  in  this  program  since 
it  introduces  time  into  the  average,  variance,  and  standard 
deviation  calculations,  weighting  the  collected  observations 
by  the  length  of  time  they  have  had  each  value.  Another 
reason  why  array  structures  were  avoided  was  because  both 
these  powerful  routines  would  only  perform  on  permanent  or 
temporary  entities.  During  the  initial  check-out  of  the 
simulation  program,  key  statistics  were  obtained  using  both 
the  ACCUMULATE  procedure  and  written  book-keeping  state¬ 
ments.  The  results  cfctained  were  identical.  Additionally, 
the  program  execution  time  was  reduced  when  the  built-in 


As  a  result,  all 


statistic  gathering  ft  actions  were  used, 
applicable  network  measurements  were  obtained  in  this 
manner. 

C.  BETBCBK  COMPONENTS 
1 .  Hcdes 

Nodes  are  the  switching  elements  for  the  data  commu¬ 
nications  network.  The  switching  elements  are  specialized 
computers  which  handle  the  many  functions  performed  by  the 
node.  ether  common  terms  for  a  node  include  IMP  (Interface 
Message  Processors  used  in  ARPANET)  ,  packet  switch,  data 
switching  exchange  and  communication  computer. 

In  this  model,  all  nodes  have  unique  identities  and 
identical  capabilities.  In  the  simulation  program  each  node 
is  a  permanent  entity  with  attributes  identifying  its  group 
and  family.  The  nede  owns  a  list  of  "neighbor"  nodes  for 
which  a  full  duplex  communications  link  exists  in  its 
LINK. SET. 

The  clock  information  required  for  the  Yen  algorithm 
is  modeled  as  the  node's  ALARM. CLOCK  set  which  contains  the 
routing  algorithm  data.  Each  time  a  node  receives  an  update 
from  a  destination  nede  for  the  first  time,  the  steps  of  the 
algorithm  are  performed  and  an  update  transmission  is 


scheduled.  To  keep  this  information,  the  node  creates  a 
EUZZEB  entity  whose  attributes  are  the  destination  node  of 
the  update  message  (CAUSE)  ,  the  tentative  transmission  time 
cf  the  update  (SETTING),  and  the  current  Update  Transmission 
list  (B02.1IST)  which  stores  the  identities  of  those  nodes 
from  which  it  has  already  received  a  particular  update. 

The  node  maintains  a  XMT.  RECORD  which  contains  a 
list  of  update  messages  which  it  has  received  and  subse- 
guently  sent  onward.  When  Mlate,,  update  messages  arrive, 
then,  the  node  can  identify  them  by  checking  the  XMT. RECORD. 

The  simulation  may  be  operated  using  either  data¬ 
grams  or  virtual  circuits  as  the  means  of  routing  message 
packets  from  source  tc  destination  node.  When  using  virtual 
circuits,  the  node  must  keep  track  of  the  circuits  or  paths 
which  packets  belonging  to  particular  messages  are  taking. 
This  is  accomplished  by  means  of  a  VIRT. CRT. LIST  which  nodes 
keep  in  order  to  ensure  that  all  packets  of  the  same  message 
take  the  same  path.  Nher.  virtual  circuits  are  used  in  the 
simulation,  a  route  is  established  by  the  first  packet  of  a 
message.  This  "trail-blazer"  packet  takes  the  then-current 
best  path  from  node  to  node  with  each  node  creating  a 
CIRCUIT  fcr  that  message.  The  CIRCUIT  has  the  attributes  of 
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message  identification  number  and  the  best  path  taken.  All 
subsequent  packets  belonging  to  the  message  will  then  take 
that  path.  The  CIRCUIT  is  "broken  down"  (i.e.  removed  from 
the  VIRT .CKT.LIST)  when  the  last  packet  of  the  message  is 
transmitted  by  the  node. 

2 .  Links 

Each  node  owns  a  LINK. SET  which  contains  the  set  of 
LINK  entities.  The  LINK  *  s  attributes  include 

1.  The  identity  cf  the  terminating  node  (TERM); 

2.  The  current  link  STATUS  which  is  either  BUSY  sending 
traffic  or  IDLE; 

3.  The  current  value  of  the  link  weight  function 
(IK.  HEIGHT); 

It  is  apparent  that  sene  of'  these  attributes  are  "physical" 
in  that  they  model  actual  network  features  such  as  TERM 
while  ethers  are  "descriptive"  in  the  sense  of  associating  a 
condition  or  state  of  an  entity  with  the  entity  itself  (i.e. 
STATUS)  .  The  power  of  the  entity-attribute  structure  is 
very  apparent  here.  Ey  associating  the  condition  cr  state 
cf  an  entity  with  the  entity  itself,  a  simple  methed  of 
keeping  track  and  thus  analysing  very  complicated  processes 
is  accomplished. 
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In  using  a  set  structure  to  describe  the  link 
connectivity  of  a  network,  a  great  degree  of  flexibility  was 
added  to  the  possible  network  topologies  available  within 
the  simulation.  The  option  also  exists  to  dynamically  alter 
that  tcpclogy  during  a  simulation  run  in  order  to  model  such 
cccurences  as  new  nodes  entering  the  system  or  the  destruc¬ 
tion  of  links. 

3 .  Queues 

In  an  actual  ample mentation  of  message  buffer  queues 
for  packet-switched  systems,  the  node  itself  is  likely  to 
have  a  single  memory  tuffer  designated  as  the  packet  queue. 
Under  this  scheme,  packets  awaiting  transmission  would  be 
stored  in  a  single  memory  buffer,  regardless  of  the  outgoing 
link  selected-  as  the  best  path  for  the  packet.  when  an 
cutgoing  link  which  had  been  busy  finally  became  idle,  soft¬ 
ware  would  be  required  to  scan  the  queue  for  packets 
destined  to  travel  on  that  link  next.  In  this  simulation, 
rather  than  have  a  single  packet  queue  for  the  entire  node, 
the  job  cf  buffering  packets  was  divided  up  such  that  each 
link  had  a  seperate  queue  associated  with  it.  The  tradeoff 
between  scanning  the  single  node  queue  and  dividing  allotted 
memory  space  among  the  links  is  one  of  access  time  versus 
maximum  tuffer  capacity  per  link. 
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Associating  individual  queues  with  their  links  was 
incorporated  in  the  simulation  primarily  as  a  method  of 
tracking  the  flew  of  packets  through  the  network.  Using 
this  model  means  that  when  a  packet  arrives  at  a  node,  its 
best  path  is  determined  based  upon  the  current  routing  table 
entries.  The  packet  is  then  either  transmitted  over  the 
best  path  link  or  placed  into  the  link's  queue,  depending 
upon  the  status  of  the  link.  In  the  event  of  a  busy  link 
and  an  already  large  queue,  the  best  path  for  that  packet 
when  it  finally  gets  to  the  "top"  of  the  queue  may  have 
changed  during  the  interval.  The  packet  will  then  be  sent 
to  a  node  which  is  no  longer  on  the  best  path.  The  problem 
inherent  to  link  queues  is  thus  one  of  routing  packets  based 
upon  information  when  the  packet  arrives  and  not  when  the 
packet  is  actually  transmitted.  Of  course,  when  link  gueues 
are  generally  short  the  possible  routing  errors  associated 
with  this  problem  should  not  be  substantial. 

An  alternate  model  for  the  packet  queue  required  at 
each  node  (which  was  not  simulated)  is  based  upon  a  varia¬ 
tion  of  the  single  node  queue.  When  a  packet  arrives  at  a 
node,  its  best  path  is  determined  based  upon  current  routing 
information  and  if  the  selected  link  is  busy,  the  packet  is 
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placed  in  the  single  node  queue.  When  the  packet  is  placed 
into  the  queue,  it  is  not  assigned  a  best  path  link,  but  is 
merely  placed  in  the  queue  in  first-in-first-out  order.  At 
some  later  time,  the  link  to  node  J  becomes  idle.  The  soft¬ 
ware  will  then  scan  the  queue  for  the  first  packet  whose 
test  path,  according  to  the  current  routing  table  for  its 
destination,  is  indeed  the  link  to  node  J.  Using  this 
systen,  all  packets  within  the  queue  are  going  to  be  routed 
tased  upon  the  "  freshest"  best  path  information  available  at 
the  time  a  link  becomes  idle.  By  not  freezing  the  best  path 
which  a  queued  packet  must  take  at  the  time  the  packet 
arrives,  we  ensure  that  all  packets  will  take  the  best  path 
to  their  destination  at  the  time  of  transmission. 

Each  link  also  has  an  update  queue  which  is  used  in 
the  simulation  to  model  the  priority  status  given  to  routing 
traffic.  Conceptually,  the  update  queue  appears  at  the 
"top"  of  the  packet  queue.  Updates,  then,  are  sent  before 
regular  message  traffic  when  both  the  update  and  the  message 
packet  queues  of  the  link  contain  traffic.  This  double 
queue  system  also  provided  a  convenient  way  to  model  the 
insertion  of  update  packets  into  ongoing  message  packets  by 
means  of  the  reserved  pattern  method. 
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4 .  Hgssaqeg 

The  simulation  generated  messages  which  consisted  of 
a  random  number  of  packets  based  upon  a  selected  length 
distribution.  The  distributions  used  were  uniform  (the 
maximum  message  length  was  selectable)  ,  and  geometric  (in 
which  tte  average  number  of  packets  per  message  was  picked)  . 
Each  message  PACKET  contained  a  number  of  physical  and 
descriptive  attributes.  The  physical  attributes  included 
such  things  as  the  originator  (ORG.NODE),  the  destination 
(DEST.NOEE)  and  the  message  identification  number 
(MSG. ID. NOH) .  The  descriptive  attributes  were  used  specifi¬ 
cally  for  gathering  statistics  about  the  packet's  trip 
through  the  network.  When  a  packet  was  generated,  its 
LIFETIME  was  set  ALIVE  (equal  to  1)  and  upon  reaching  the 
destination,  the  LIFETIME  became  DEAD  (equal  to  0).  In  this 
way  the  average  packet  transit  time  was  determined  by  aver¬ 
aging  the  sum  of  all  packet  LIFETIME'S  using  the  ACCUMULATE 
procedure.  In  the  same  manner,  the  average  time  that  a 
packet  was  queued  during  its  trip  was  found  by  setting  QSTAT 
"ALIVE"  whenever  the  packet  entered  a  link  queue.  Upon 
removal  from  the  queue,  QSTAT  was  pronounced  DEAD. 


The  packet  attributes  of  P.NAHE  and  P.  ARRIVAL  are 
used  in  order  that  the  arrival  time  of  a  message  packet  in 
transit  can  be  modified,  in  the  event  that  an  update  packet 
is  inserted.  In  order  that  message  packets  in  transit  not 
be  in  a  limbo  state  as  far  as  the  simulation  program  was 
concerned,  a  "propagation  queue"  (PROP. QUEUE)  was  developed. 
When  packets  were  transmitted  they  were  filed  into  the 
link's  PROP. QUEUE  and  upon  arrival  to  the  next  node,  removed 
therefrom.  This  was  required  in  order  to  keep  accurate 
track  of  the  identity  of  all  messages  in  transit.  The 
information  contained  in  P. NAME  and  P. ARRIVAL  was  related  to 
the  name  and  scheduled  occurence  time  of  the  event  corre¬ 
sponding  to  the  arrival  of  that  packet.  In  this  way,  if  an 
update  was  inserted,  the  scheduled  arrival  time  of  the 
packet  could  be  lengthened  accordingly.  The  details 
involving  hew  the  carcellirg  and  rescheduling  of  the  pack¬ 
et's  arrival  is  accomplished  is  included  in  the  program. 

The  length  of  the  packet  was  described  in  terms  of 
the  time  required  to  transmit  a  packet  over  one  link.  This 
time  was  selected  by  using  a  channel  capacity  of  20,000  bits 
per  second  per  link  and  a  packet  size  of  1000  bits.  The 
packet  transmission  time  was  then 
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EKT.XHN.TIHE  =  1  000  bits  /  20,000  bps 

=  0.05  seconds  . 

5.  Pedate  Packets 

Routing  information  was  disseminated  among  nodes  by 
means  of  OEEATE  packets.  The  attributes  of  an  UPDATE  iden¬ 
tified  the  destination  as  being  either  a  node,  group  or 
family  (CIASS)  and  whether  or  not  the  update  was  "regular” 
cr  "warning"  (VARIETY).  A  regular  update  is  the  simple 
message  described  in  the  Yen  algorithm.  The  warning  update 
is  used  in  the  hierarchical  version  to  enable  nodes  of  a 
group  or  family  to  transmit  their  unit  update  message  at  the 
same  time  (FIRI NG.  TI  BE),. 

The  update  also  had  an  additional  counter  which 
indicated  the  number  of  heps  which  it  had  taken.  This 
counter  was  employed  in  anticipation  of  a  problem  which  can 
cccur  when  hierarchical  routing  is  utilized.  Nodes  residing 
cn  or  near  unit  borders  can  have  neighbors  which,  though 
quite  clcse,  are  located  in  different  units.  Routing  infor¬ 
mation  tc  these  close  neighbors  would  normally  be  in  terms 
of  the  best  path  to  the  unit,  rather  than  to  the  specific 
node  itself.  Thus  unit  (vice  nodal)  routing  information  may 
result  in  much  longer  paths  being  taken  between  nodes  that 
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are  very  close  to  each  other  but  belong  to  different  units. 
A  more  efficient  routing  should  be  achieved  by  having  nodes 
maintain  routing  information  on  close  neighbors,  regardless 
cf  the  unit  boudaries.  The  proposed  method  on  how  this 
"boundary"  routing  information  can  be  developed  utilizes 
this  hep  counter. 

Ey  examining  the  HOP.  COUNT  of  "node"  updates  which 
are  received,  precise  routing  information  to  "close"  neigh¬ 
bors  cutside  of  the  the  basic  unit  can  be  developed.  When 
this  technique  was  used,  the  user  parameter  HOP. LIMIT  was 
set  to  indicate  the  "depth"  at  which  node  updates  were 
allowed  tc  travel  intc  groups  or  families  which  were  not  a 
part  cf  their  basic  group.  Therefore,  whenever  a  node 
received  such  an  update  from  outside  of  its  basic  group  the 
HOP. CCONT  would  first  be  checked.  If  the  packet  had  trav¬ 
eled  ever  tie  specified  HOP. LIMIT,  then  the  update  would  be 
ignored.  If,  however,  the  HCP. COUNT  was  within  the  limit 
then  the  normal  update  procedure  would  commence.  The 
receiving  node  would  now  possess  special  routing  information 
to  a  neighboring  node  which  was  not  in  its  group.  This 
ability  tc  maintain  routing  information  to  all  close 
neighbor  nodes  regardless  of  their  unit  assignment  should 
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assist  in  the  total  performance  of  the  network.  The 
benefits  from  this  technique  are  expected  to  exceed  the 
small  routing  table  increments  required  to  maintain  these 
entries. 

Tfce  size  of  the  update  message  was  selected  to  be 
relatively  short#  in  keeping  with  the  simple  information 
which  it  contains.  For  an  update  packet  of  length  40  bits 
the  corresponding  transmission  time  was 

U.XMN.TIME  =  40  bits  /  20,000  bps 

=  0.00125  seconds  . 

Update  packets  were  given  priority  over  regular  message 
traffic  through  the  use  of  the  insertion  technique  and  a 
separate  update  queue.  The  insertion  technique  allowed 
updates  tc  be  transmitted  when  message  traffic  was  already 
in  transit.  However,  updates  were  not  allowed  to  be 
inserted  into  other  updates.  If  a  link  was  busy  sending  an 
update  packet  then  additional  update  packets  would  be  placed 
in  the  update  queue.  Upon  completion  of  transmission,  all 
waiting  update  packets  would  be  sent  before  message  traffic 
was  resumed. 
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0.  HETHCBK  OPBBATIOU 


The  transmission  cf  message  packets  between  nodes,  the 
firing  of  an  update  packet  at  the  precise  time  and  all  the 
ether  network  activities  required  for  the  simulation  were 
modeled  by  SIMSCHIPT  "events".  Events  are  routines  which 
are  scheduled  to  take  place  during  a  simulation.  An 
initialling  program  called  "Main",  schedules  events  to 
cccur,  and  during  the  course  of  the  simulation,  either 
events  or  subroutines  can  schedule  more  events. 

The  sequencing  cf  events  within  the  simulation  is 
controlled  by  a  simulation  clock  and  an  event  queue.  At  any 
given  moment  during  a  run,  the  event  queue  contains  the  name 
of  all  scheduled  events  with  their  order  in  the  queue  depen¬ 
dent  upon  their  scheduled  time  of  occurence.  The  "Main" 
program  leads  the  event  queue  with  the  scheduled  starting 
events.  At  "Start  Simulation"  the  first  event  scheduled 
(which  is  at  the  head  of  the  event  queue)  is  executed.  This 
event  may  in  turn  schedule  ether  events  to  take  place  either 
NOW  (next  in  the  event  queue)  or  at  some  future  time.  The 
simulation  stops  when  no  further  events  are  in  the  event 
queue,  whereupon  control  passes  back  to  the  Main  program. 
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In  keeping  with  the  initial  design  goal  of  a  modular¬ 
ized,  adaptable  program  which  can  be  used  in  future 
research,  all  routines  and  events  were  written  such  that 
they  were  a  part  of  cne  of  the  following  four  divisions: 

1.  Preparation  Pricr  to  Simulation  (P) 

2.  Update  Routing  Protocol  (U) 

3.  Hessage  Packet  Transport  (M) 

4.  Evaluation  of  Network  Performance  (E) 

The  single  letter  at  the  beginning  of  each  name  was  used  in 
the  computer  program  to  indicate  the  division-  for  each 
routine  and  event  (i.e.  E2. COLLECT. DATA  is  an  Evaluation 

routine).  The  number  after  the  letter  designator  indicates 
their  relative  order  c£  appearance  in  the  program.  Soutines 
and  events  within  the  same  division  ar.e  basically  indepen¬ 
dent  cf  those  in  the  ether  divisions.  This  means  that  modi¬ 
fications  and  alterations  within  a  division  will  not 
directly  effect  ’’outside”  routines.  Descriptions  of  each 
routine  and  event  are  provided  in  the  program  comments  which 
detail  the  function  and  operation  of  each  routine.  In  addi¬ 
tion  an  alphabetic  summary  of  all  global  variables  is 
provided  at  the  beginning  of  the  program.  The  purpose  of 
this  section  is  not  tc  repeat  those  details  but  to  give  an 
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overview  of  the  network  operation  and  so»e  insight  into  the 
ever  present  question  as  to  why  the  simulation  was  written 
the  way  it  was.  It  is  hoped  that  through  understanding 
"why"  things  were  done  as  they  were,  follow  on  work  can  move 
forward  rather  than  needing  to  reinvent  the  wheel. 

1  •  Prenarat ion  Frior  to  simulation 

The  seven  routines  which  make  up  this  division  are: 

1.  FI. BUILD. NETSCRK 

2.  F2. CONNECT.  LINKS 

3.  F3. INITIAL. RCOTING.  TABLE 

4.  F4.  STATIC.  EVENTS 

5.  ES.  DYNAMIC.  EVENTS 

6.  F6.EURGE. EVENT. QUEUE 

7.  P7. ZEROIZE.  SETS 


This  division  performs  all  initializing  functions  which  are 
required  prior  to  the  start  of  a  simulation  run.  These 
functions  can  be  broken  down  into  three  areas  which  are  the 
construction  of  the  network,  the  loading  of  the  event  queue 
with  the  starting  events,  and  the  "cleaning  of  the  slate" 
prior  to  the  start  of  the  next  run  of  a  multiple  run 
simulation. 
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The  network  is  built  using  two  routines  which  divide 
the  task  into  two  parts.  The  first  routine,  BUILD. NETWOBK, 
takes  the  input  data  which  lists  the  nodes  and  their  group 
and  family  relationships  and  produces  the  program  node  iden¬ 
tity  numbers  which  are  used  in  the  simulation.  These 
program  node  numbers  are  a  single  value  which  uniquely  iden¬ 
tifies  a  node,  which  otherwise  would  require  a  three  part 
name.  After  creating  the  nodes,  the  link  connectivity  is 
produced  using  CONNECT. LINK S.  In  this  routine  duplex  links 
are  constructed  between  specified  node  pairs.  Upon  comple¬ 
tion  each  node  has  its  own  LINK. SET  which  contains  the  iden¬ 
tity  of  the  terminating  node.  By  using  sets  for  this 
portion  cf  the  model,  the  ability  to  produce  dynamic  changes 
in  the  link  connectivity  of  a  system  can  be  done  simply  by 
adding  or  deleting  LINKs  from  the  LINK. SET. 

As  an  additional  feature,  a  graphics  routine  was 
written  which  incorporated  the  same  data  set  used  in  these 
two  routines.  The  network  figures  in  this  report  were 
produced  from  this  routine.  In  this  way ,  a  visual  confirma¬ 
tion  could  he  made  of  all  test  networks  as  to  their  topology 
to  ensure  their  correctness  prior  to  simulation. 


Cne  of  the  problems  anticipated  in  this  simulation 
was  that  of  producing  an  initial  best  path  routing  table 
prior  to  the  start  of  the  simulation.  Rather  than  produce  a 
routing  table  by  some  external  means  or  simply  assigning  a 
randomly  generated  table,  an  alternate  approach  was  used, 
since  the  Update  Routing  Protocol  routines  could  operate 
independently  of  the  Message  Packet  Transport,  the  solution 
was  simply  to  run  the  simulation  without  message  traffic  and 
with  only  one  update  per  destination  node,  group  or  family. 
With  all  link  weights  set  to  unity,  a  least  hop  routing 
table  was  produced  by  INITI AL. ROUTING. TABLE.  The  resulting 
table  was  stored  in  a  BEST. PATH  matrix.  As  a  time  saver,  an 
additional  copy  of  this  table  was  made  (DUP. BEST. PATH)  for 
use  with  multiple  simulation  runs. 

The  event  queue  was  loaded  with  either  STATIC. EVENTS 
or  DYNAMIC  EVENTS.  Using  STATIC.  EVENTS ,  the  initial  routing 
table  was  fixed  throughout  the  simulation  by  simply  not 
scheduling  any  events  from  the  Update  Routing  Protocol  divi¬ 
sion  to  take  place.  On  the  other  hand,  when  the  simulation 
was  run  using  the  dyramic  routing  algorithm,  events  from  the 
Update  division  were  loaded  in  the  event  queue. 


1c  stop  a  simulation  after  a  giver  period  cf  tine, 
the  event  queue  is  eiptied  using  PURGE. EVENT.  QUEUE.  Upon 
completion  cf  this,  all  statistic  gathering  routines  and 
dynamic  set  structures  were  cleared  with  ZEROI2E.SETS.  To 
ensure  the  repeatability  of  simulation  runs  an  added  precau¬ 
tion  was  taken  with  all  of  the  system  random  number  genera¬ 
tors  used  in  the  pregram.  These  were  reset  with  their 
starting  "seed”  values  in  order  to  ensure  that  multiple 
simulations  would  have  identical  inputs. 

2.  Update  Routing  Protocol 

The  connection  between  the  Message  Packet  Transport 
division  and  the  Update  Routing  Protocol  division  is  the 
EEST . PATH  routing  table.  Events  and  routines  within  the 
Update  divison  are  responsible  for  producing  and  maintaining 
this  table.  In  this  research  the  Ten  algorithm  is  simulated 
within  this  division  using  a  total  of  eight  events  and 
routines: 

1.  U1  .GENERATE.  UEEATE  (EVENT) 

2.  U2. TRANSMIT.  UEDATE  (ROUTINE) 

3.  U3.  INSERT  .UPDATE  (ROUTINE) 

4.  U4. RECEIVE.  UPIITE  (EVENT) 

5.  U5. LINK.  WEIGHT. CALCULATION  (EVENT) 
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6.  06.NCDE.WAKE.0E  (EVENT) 

7.  07. UNIT. FIRING  (EVENT) 

8.  08. ERASE.  RECORD  (EVENT) 

The  starting  event  used  by  the  Yen  algorithm  is 
GENERATE.  OP  DATE  which  is  scheduled  for  each  node,  group  and 
family  at  the  beginning  of  the  simulation.  During  the 
course  of  the  siiulaticn  each  node  will  continue  to  generate 
its  own  destination  update  at  regular  time  intervals.  In 
the  case  cf  the  hierarchical  version,  a  '•leader"  node  is 
selected  in  each  unit  which  then  generates  the  unit  warning 
message  at  regular  intervals.  The  time  interval  between 
node,  grcup  and  family  update  messages  are  all  user  parame¬ 
ters  which  may  be  independently  selected. 

The  updates  are  then  transmitted  to  neighbor  nodes 
by  means  of  the  TRANSMIT . UPDATE  routine.  This  routine 
performs  the  critical  function  of  ensuring  that  the  effects 
cf  update  traffic  inserted  within  the  bit  stream  of  a  propa¬ 
gating  message  packet  is  properly  modeled.  The  routine  is 
able  to  handle  the  transmission  of  an  update  differently 
based  on  the  three  possible  circumstances  by  which  a  link 
may  be  busy: 
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1.  Regular  message  traffic  is  being  transmitted  with  no 
"inserted”  updates  presently  in  transit; 

2.  Update  traffic  is  in  transit  which  has  net  been 
"inserted"  into  a  regular  message  packet; 

3.  "Inserted"  update  traffic  is  currently  in  transit 
within  a  regular  message  packet's  bit  stream. 

In  cases  (1)  and  (3),  the  message  packet  in  transit  has  to 
be  "lengttened"  to  account  for  the  additional  update  which 
has  been  inserted  into  its  bit  stream.  Routine 
INSERT. UPDATE  readjusts  the  message  arrival  time  when  an 
update  is  inserted  into  a  message  packet. 

Upon  reception  .of  an  update,  the  event 
RECEIVE. UPDATE  performs  the  basic  calculation  of  the  Yen 
algorithm.  The  update  is  determined  to  be  either  "Regular" 
or  "Warning"  with  appropriate  action  taken.  In  the  case  of 
a  regular  update,  the  value  of  the  link  weight  is  calculated 
and  the  time  of  transmission  calculated  in  accordance  with 
the  Yen  algorithm. 

The  user  has  the  option  of  selecting  one  of  the  five 
link  weight  functions  presented  in  the  last  chapter.  If  a 
link  weight  function  is  chosen  which  uses  a  window  technique 
(as  Method  5  did),  a  LINK  .  WEIGHT. CALCULATION  is  performed 
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each  "window"  of  time  throughout  the  simulation.  The  length 
of  time  for  a  window  and  the  number  of  windows  in  a  total 
averaging  period  are  user  controlled  parameters.  During  a 
IINK.  HEIGHT. CALCULATION,  each  link  in  the  network  would  have 
a  WEIGHT  computed  for  the  window  time  which  is  filed  into 
the  link's  SET. OP.  WEIGHTS.  The  number  of  WEIGHTS  in  the  set 
is  limited  to  the  number  of  windows  selected  and  therefore 
as  a  new  WEIGHT  is  filed,  the  oldest  WEIGHT  is  removed. 
This  process  provides  a  close  approximation  to  a  continu¬ 
ously  sliding  window.  Upon  raception  of  an  update,  the 
average  cf  the  link  weight  function  is  computed  by  taking 
the  average  of  all  WEIGHTS  in  the  SET. OF.  WEIGHTS. 

Opon  completion  of  these  calculations  the  node 
schedules  itself  to  "wake  up"  (NODE.  WAKE.  OP)  when  the  best 
path  time  of  transmission  is  to  occur.  This  is  accomplished 
ty  creating  a  BUZZES  which  has  attributes  identifying  the 
update  ty  its  originating  node  (CAUSE)  and  the  tine  of 
origin  (EUZ.BEG).  The  BUZZES  also  contains  the  tentative 
time  cf  update  transaission  (SETTING) ,  the  associated  best 
path  node  (TEHP.  BP)  and  the  name  of  the  NODE.  WAKE.  UP  event 
which  had  been  scheduled  (BUZ. WAKE). 


This  last  item  was  critical  to  the  operation  of  the 
program.  In  order  tc  change  the  time  of  update  transmission 
in  cars  a  "tetter”  route  occurs,  the  previously  scheduled 
NODE. SAKE. UE  event  has  to  be  cancelled  and  then  rescheduled. 
In  order  to  cancel  a  specific  event  residing  in  the  event 
queue,  it  was  required  to  have  a  specific  "name".  The  act 
cf  giving  an  event  a  name  and  then  storing  that  name  as  an 
attritute  of  the  entity  involved  with  that  event  was  used 
throughout  this  simulation.  In  any  truly  dynamic  and 
distributed  simulation  such  as  this  one,  the  ability  to 
properly  cancel  and  reschedule  events  whose  time  of  occu¬ 
rence  are  subject  tc  change  was  critical  to  its  successful 
cperation. 

The  identity  cf  the  neighbor  node  ( BUZ.  NODE)  from 
which  the  update  was  received  is  also  maintained  in  a  set 
(BOZ.  LIST)  which  is  owned  by  the  BUZZES.  This  is  similar  to 
the  Update  Transmission  List  cf  the  algorithm,  but  instead 
cf  deleting  the  nodes,  this  technique  adds  the  nodes.  when 
ether  updates  arrive,  the  ALARM. CLOCK  is  first  checked  tc 
see  if  there  already  exists  a  BUZZER  on  this  particular 
update.  If  one  is  found,  then  the  new  time  "setting"  is 
compared  to  the  previcus  BUZZER.  If  the  previous  setting  is 


still  better,  no  further  action  is  taken  except  that  the 
identity  of  the  node  is  added  to  the  BUZ. LIST.  If  the  new 
setting  is  better,  then  the  BUZZER  is  reset  and  the 
NODE. BAKE. UE  event  rescheduled  to  the  new  time.  Upon  waking 
up,  the  ncde  transmits  the  update  to  all  nodes  which  are  not 
listed  in  the  BUZ. LIST. 

Hhen  using  the  hierarchical  version,  the  update 
received  can  be  of  a  warning  nature.  Upon  reception  of  a 
warning  message,  the  node  retransmits  the  warning  using  a 
flooding  technique  and  then  schedules  its  own  unit  update 
transmission  using  the  event  UNIT. FIRING.  The  event 
UNIT. FIRING  is  scheduled  at  the  firing  time  of  a  regular 
group  and  family  update  message.  The  events  UNIT. FIRING  and 
NODE.  BAKE.  UE  are  similar  in  function  except  the  latter 
refers  tc  the  unit  update  t ransmissions. 

The  node  alsc  maintains  a  record  of  all  update 
retransmissions  which  is  kept  in  the  XMT. RECORD.  In  this 
way,  "late”  updates  arriving  at  a  node  can  be  identifed  and 
ignored.  In  order  that  this  record  not  become  excessively 
long,  the  event  ERASE.  RECORD  is  scheduled  for  each  record 
after  a  set  time  interval.  Upon  execution,  the  outdated 
record  is  removed  from  the  XMT. RECORD  and  destroyed. 


3.  Message  gacket  Tran  sport 


Tt€  two  events  falling  into  this  category  are 
involved  with  the  generation,  transmission  and  reception  cf 
message  traffic  within  the  network: 

1.  M  1.  GENE  RATE.  MESSAGE  (EVENT) 

2.  M2. RECEIVE.  MESSAGE. PACKET  (EVENT) 

Event  GENERATE. MESS  AGE. PACKET  produces  new  message 
traffic  for  the  network.  The  traffic  intensity  (FPS.AVE) 
and  the  number  of  packets  per  message  (AVE.PPM)  are  both 
controllable  through  simulation  parameters.  This  event 
occurs  each  time  a  new  message  is  generated.  The  average 
time  between  consecutive  messages  is  then 

MSG. GENE5ATICN. INTERVAL  =  AVE.PPM  /  PPS.AVE 

A  Pcisscr  arrival  distribution  was  assumed  and  therefore 
this  interval  was  used  as  the  exponential  interarrival  time 
average  between  messages. 

Packets  were  transmitted  or  queued  depending  upon 
the  link  status.  A  BECEIV E. MESS  AGE. PACKET  event  was  sched¬ 
uled  to  occur  PKT.  XMN.TIME  seconds  after  a  packet  was  trans¬ 
mitted.  This  arrival  time  was  subject,  however,  to 
variation  due  to  the  possible  insertion  of  an  UPDATE  into 
the  simulated  "bit  stream"  cf  the  propagating  packet. 
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The  selection  of  the  source  and  destination  nodes 
for  each  message  was  usually  done  using  a  uniform  distribu¬ 
tion  so  that  all  node  pairs  were  equally  likely.  Provisions 
were  made,  though,  so  that  the  simulation  could  be  run  using 
unbalanced  traffic  distributions.  Under  these  conditions, 
selected  source-destination  node  pairs  were  chosen  to 
produce  non-unifcrm  distributions  of  traffic. 

4.  Evaluation  of  Network  Performance 

The  Evaluation  routines  and  events  collect  and 
output  all  parameters  which  change  for  multiple  runs  and  the 
accumulated  statistical  measurements.  The  seven  routines 
and  events  are  as  follows: 

1.  El. TRANSIENT. EIANKING  (EVENT) 

2.  E2. COLLECT.  DATA  (EVENT) 

3.  E3.PARAMETER. LISTING  (ROUTINE) 

4.  E4. NETWORK.  PEEFORMANCE.  REPORT  (EVENT) 

5.  E5.BEST.  PATH.  ECOTING  .TAELE  (ROUTINE) 

6.  E6. LINK. WEIGHT. HATRI X  (ROUTINE) 

7.  E7.TRAPPIC.  DISTRIBUTION  (ROUTINE) 

PARAMETER. LISTING  provides  the  values  assigned  by 
the  user  to  all  pregram  parameters  which  do  not  change 
during  the  course  cf  multiple  simulation  runs.  This 


information  is  outputted  prior  to  the  start  of  the  first 
simulation.  During  the  simulation  itself,  the  event 
COLLECT. I ATA  samples  the  status  of  the  network  at  times 
which  are  controlled  by  the  user.  Onder  normal  conditions, 
a  particular  number  cf  samples  is  selected  which  then  occur 
at  regular  intervals  throughout  the  run.  If  100  SAMPLES  are 
selected  for  a  10  second  run  than  the  interval  between 
consecutive  samples  wculd  be  0.1  seconds.  COLLECT. DATA 
takes  measurements  on  the  following  items: 

1.  The  total  number  of  packets  in  the  network. 

2.  The  mean  link  utilization  of  the  network. 

3.  The  mean  time  it  takes  for  a  packet  to  complete  its 
trip. 

4.  The  mean  gueue  size  of  the  network. 

5.  The  mean  time  per  hop  of  each  packet. 

Collected  data  is  stored  in  external  memory  and  then 
retrieved  by  graphical  routines.  The  plotted  results 
enabled  the  status  of  the  network  to  be  analyzed  as  a  func¬ 
tion  cf  simulation  time  and  many  examples  of  the  results 
appear  herein. 

Used  in  conjunction  with  DATA. COLLECTION  was  the 
event  TRANSIENT. ELANKING.  Its  purpose  was  to  remove  the 


effects  which  the  ”  start-up”  behavior  of  the  simulation  had 
upon  the  statistics  gathering  routines.  At  the  beginning  of 
each  simulation  run,  the  network  performance  statistics 
displayed  transient  behavior  which  rapidly  settled  as 
traffic  "filled”  the  network  and  the  update  process  began  to 
function.  Being  interested  in  the  steady  state  condition  of 
the  network,  the  statistics  taken  during  this  period  were 
removed  by  TRANSIENT. BLANKING  which  reset  all  statistical 
gathering  routines.  TRANSIENT. BLANKING  for  the  simulation 
runs  occurred  five  seconds  after  the  start  of  the 
simulation. 

The  NETWORK.  PERFORMANCE.  REPORT  gives  a  detailed 
summary  of  statistics  on  link  utilization,  message  and 
update  queues,  and  message  packet  trips.  The 

EEST. PATH. ROOT IN G. TAEIE  and  the  LINK . WEIGHT. MATRIX  give  the 
current  status  cf  their  respective  quantities  in  matrix 
format.  Lastly,  the  TRA FFIC. DISTR IBOTION  summarizes  the 
number  of  packets  generated  between  each  source-destination 
node  pair,  the  number  of  packets  completing  their  trips 
between  the  same  and  the  average  trip  time  for  these 

packets.  This  routine  is  quite  useful  when  analyzing  the 
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network  performance  using  unbalanced  traffic  distributions. 


5.  Example  Opdate  Sequence  - 

Table  IV  gives  the  simulation  results  for  the  same 
sample  network  used  previously  in  Chapter  II,  Pigure  3.1. 
The  various  events  are  described  in  the  order  of  their  time 
of  occurrence  during  the  update  sequence  of  the  single 
destination  node.  The  results  coincide  exactly  with  those 
obtained  previously  when  the  steps  of  the  algorithm  were 
worked  through  by  hand.  The  table  consists  of  the  actual 
output  statements  which  were  produced  during  the  simulation 


run 


TABLE  IV 

Siaulation  Best  Path  Results 


TIME 

o. 

o. 

0. 

2.0000 

2.0000 

2.0000 

3.0000 

3. 0000 


(NOOE)i  EVENT  OE  SCRIPT  I  ON 


(  1)  i  NOOE  UPDATE  ORIGINATED. 

SENT  TO  THE  FOLLOWING  NOOESt 

2 

3 

1  UPOATE  GENERATEO  SO  FAR. 

(  2)  <  *»NEH  ALARM  CLOCK**—  UPDATE  (  1.  0. 

SETTING  TO  GO  OFF  AT  2.0D00. 

(  3>  t  **NEH  ALARH  CLOCK**—  UPDATE  I  ].  0. 

SETTING  TO  GO  OFF  AT  1.0000. 

(  2)  i  **HAKE  UP  SOUNOEO**  —  UPDATE  (  1,.  0. 

BEST  PATH  FROH  2  TO  1  IS  I. 

UPOATE  SENT  TO  3 

UPOATE  SENT  TO  1 

(  3)  t  ALARM  CLOCK  RESET  -  UPDATE  (  1.  D.  ) 

NON  SET  TO  GO  OFF  AT  3.DD0D. 

(  VI  i  ««NEH  ALARM  CLOCK**—  UPDATE (  1,  0. 

SETTING  TO  GO  OFF  AT  5. DODD.  . 

(  3)  »  **MAKE  UP  SOUNDED**  —  UPDATE  (  1.  0. 

BEST  PATH  FROH  3  TO  1  IS  2. 

UPOATE  SENT  TO  1 

(  4)  i  ALARH  CLOCK  RESET  -  UPDATE  (  1.  D.  ) 

NON  SET  TO  GO  OFF  AT  4.0000. 

•«  RETRANSMISSION  OF  UPDATE  NOT  NEEDED  •• 
BEST  PATH  FROH  4  TO  I  IS  3. 


BEST  PATHS 


FH-TO  N  I  N  2  N  3  N  4 
N  1 

N  2  I 

N  3  2 

N  4  3 


)  FROH  NOOE  1. 

)  FROH  NODE  1. 

) 

FROH  NOOE  2. 

)  FROM  NODE  2. 

) 

FROH  NOOE  3. 
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V.  SI MOLATIOH  BBSDLTS 


Simulating  the  Yen  routing  algorithm  in  a  packet- 
switched  comaun  icaticns  network  was  the  focus  cf  this 
research.  The  first  phase  of  the  study  dealt  with  deter¬ 
mining  a  link  weight  function  which  provided  an  viable  esti¬ 
mate  cf  the  state  cf  the  network.  When  this  particular 
function  was  used  in  conjunction  with  the  Yen  algorithm,  a 
very  efficient  traffic  routing  procedure  occurred  fcr  a 
variety  cf  network  ccnditions.  The  testing  of  the  algorithm 
using  this  link  weight  function  comprised  the  second  phase 
of  the  simulation  wcrk.  Here  the  algorithm  was  subjected  to 
a  multitude  of  different  conditions  in  order  to  thoroughly 
test  its  operating  characteristics  and  evaluate  its  perform¬ 
ance.  The  last  phase  of  the  simulation  involved  repeating 
the  process  of  phase  two  using  the  hierarchical  version  of 
the  Yen  algorithm  which  was  developed  in  the  last  chapter. 
Comparisons  could  then  be  made  between  both  the  "nodal"  or 
basic  algorithm  and  the  hierarchical  version. 


I.  HEASUEIHG  ALGOHIT0H  PERFORMANCE 


In  seeking  to  determine  the  performance  of  the  algo¬ 
rithm,  statistics  were  chosen  which  related  to  the  number  of 
packets  within  the  network  at  any  given  time.  The  reasoning 
behind  this  is  related  in  part  to  the  analytical  techniques 
presented  in  Chapter  IV  which  are  useful  in  validating  the 
simulation  model  itself.  Both  Little’s  Result  and  the 
Follaczek-Khinchin  formula  can  give  answers  for  the  average 
number  of  packets  within  a  network  when  the  traffic  distri¬ 
butions  are  known.  Therefore  by  using  those  particular 
statistics,  a  means  cf  validating  the  simulation  model  prior 
to  testing  the  algorithm  was  possible.  The  second  reason  is 
due  tc  the  nature  cf  the  simulation  "run"  itself  and  bow 
statistics  are  collected  and  evaluated  within  the  pregram. 

Perhaps  a  more  faiiliar  measurement  used  in  performance 
evaluation  of  an  algorithm  is  the  mean  packet  delay  and  not 
the  mean  number  of  packets  within  the  network.  Little's 
Result  intimately  relates  these  two  statistics  and  therefore 
the  choice  may  not  appear  too  critical.  This  is  indeed  the 
case  under  most  conditions  of  performance  evaluation. 
However,  the  lesser  used  quantity  was  chosen  in  this  pregram 
for  a  reason  which  can  best  be  seen  by  showing  how  statis¬ 
tics  were  gathered  during  a  simulation  run. 


At  any  moment  during  a  . simulation  run  the  number  of 
message  packets  generated,  in  transit  and  having  completed 
their  trips  can  te  described  as: 

1.  X  packets  have  been  generated. 

2.  Y  packets  have  completed  their  trip  from  source  to 
destination. 

3.  X  -  Y  packets  are  currently  in  the  network. 

The  mean  packet  delay  of  all  Y  packets  can  be  computed. 
However,  this  does  net  take  into  account  those  X  -  Y  packets 
which  are  still  in  transit.  One  could,  of  course,  approxi¬ 
mate  their  delay  based  upon  seme  scheme,  but  this  may  not  be 
valid  under  some  very  important  conditions.  If  for  any 
reason  tte  routing  algorithm  fails  and  congestion  develops, 
it  is  possible  that  the  mean  delay  of  packets  which  have 
completed  their  trip  will  not  change  to  reflect  the  current 
slow  down  very  rapidly.  Hcwever,  if  the  number  of  packets 
in  the  system  at  a  given  time  were  used  as  the  index,  this 
condition  cculd  readily  be  noted.  The  mean  packet  delay  was 
not  used  because  at  any  moment  during  a  simulation  run,  this 
factor  accounts  only  for  those  packets  which  have  completed 
their  trip  and  net  fer  ones  which  are  currently  in  transit. 
By  using  the  number  of  packets  in  the  system  at  any  given 
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tine,  the  performance  of  the  routing  algorithm  could  accu¬ 
rately  be  determined.  "  The  better  the  algorithm  performed, 
the  fewer  the  number  of  packets  in  transit  at  any  given 
time. 

B.  TEST  lETWBK 

The  tcpclogy  of  the  network  used  is  given  in  Figure  5.1. 
The  network  has  thirteen  nodes  and  thirty  full  duplex  links. 
In  describing  the  characteristics  of  the  network  some  terms 
familiar  in  graph  theory  are  first  defined. 

A  complete  graph  exists  when  all  nodes  are  connected  to 
all  other  ncdes  by  a  direct  link.  All  properties  of  a 
complete  graph  are  specified  simply  by  indicating  the  number 
cf  nodes.  A  test  network  was  chosen  deliberately  which  was 
not  complete  in  order  that  there  would  be  multiple  hep  paths 
between  seme  node  pairs. 

Tc  indicate  the  relative  '’connectiveness"  of  a  given 
graph,  the  link  connectivity  and  node  connectivity  cf  a 
graph  as  a  whole  is  specified.  The  link  connectivity 
between  two  nodes  is  the  minimum  number  of  links  that  must 
be  removed  from  the  graph  to  disconnect  them.  The  link 
connectivity  of  the  graph  as  a  whole  is  the  minimum  of  the 
link  connectivity  of  all  pairs  of  nodes.  For  a  complete 
N-node  graph,  the  link  connectivity  is  N  -  1. 
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Figure  5.  1  Test  Network  for  Nodal  Ten  Algorithm 

Analogous  to  the  link  connectivity  between  nodes,  the 
node  connectivity  is  the  minimum  number  of  other  nodes  whcse 
removal  will  disconnect  the  tvc  nodes.  The  node  connec¬ 
tivity  of  the  graph  is  the  minimum  taken  over  all  ncde 
pairs.  Since  all  nodes  are  directly  connected  in  a  complete 
N-node  graph,  its  node  connectivity  is  defined  to  be  N  -  1. 


Ey  inspection,  it  is  found  that  the  test  network  has  a 
link  connectivity  of  4.  This  can  be  seen  between  nodes  1 
and  13  which  are  completely  seperated  by  the  removal  of 
links  (1,2),  (1,3),  (1,4)  and  (1,5).  The  node  connectivity 

is  also  4  which  can  te  seen  by  the  isolation  of  node  2  by 
removing  nodes  1,  3,  6  and  9.  As  a  comparison,  had  this  13 
node  network  been  linked  differently  such  that  it  formed  a 
complete  graph,  both  its  link  and  node  connectivities  would 
have  teen  12.  The  difference  between  12  and  4  gives  an 
indication  that  this  test  network  is  lightly  connected  and 
that  most  paths  between  node  pairs  will  involve  multiple 
hops. 

C.  STATIC  BOOTIBG  BESOLTS 

The  simulation  program  was  first  run  using  a  fixed 
routing  table.  This  initial  routing  table  was  determined  by 
applying  the  Yen  algorithm  with  all  link  weights  set  tc  the 
same  value  cf  1.  In  this  manner  the  best  paths  were  these 
which  required  the  fewest  heps.  The  routing  table  which  was 
produced  is  included  in  Table  V.  This  particular  result  is 
in  no  way  unique  as  there  are  numerous  paths  between  node 
pairs,  all  requiring  the  same  number  of  hops.  The  selection 
of  this  specific  table  was  not,  however,  critical  tc  the 
results  obtained. 
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The  simulation  program  automatically  determines  the 
least  hep  routing  table  without  the  designer  having  to 
initialize  this  matrix.  This  is  accomplished  by  running  the 
simulation  without  message  packet  traffic  for  a  complete 
update  cycle.  The  update  cycle  consists  of  each  node,  group 
and  family  originating  its  own  destination  update  and  is 
completed  when  no  further  update  retransmissions  are 
produced.  Open  completion#  each  node  has  a  best  path 
routing  table.  This  table  is  saved  within  the  simulation 
program  and  utilized  at  the  beginning  of  subsequent  runs 
involving  message  traffic. 
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Curing  static  routing,  this  least  hop  table  was  fixed 
for  the  simulation  run.  Multiple  runs  were  performed  using 
different  traffic  levels  by  varying  the  rate  at  which 
message  packets  were  generated.  Source  and  destination 
nodes  were  selected  in  a  uniform  fashion  such  that  each 
possible  pairing  had  the  same  probability  of  selection. 
Each  message  was  fixed  to  a  length  of  one  packet  and  the 
simulation  run  for  a  period  of  thirty  seconds.  Figure  5.2 
presents  the  summary  cf  the  network  performance. 

The  results  indicate  that  the  network  had  become 
''unstable'1  when  the  packet  generation  rate  was  300  packets 
per  second.  The  terms  stable  and  unstable  are  used  to 
describe  the  general  state  of  traffic  flow  within  the 
network.  Given  an  unchanging  rate  of  packets  entering  a 
system,  a  stable  network  will,  after  some  transient  start-up 
behavior,  settle  to  a  relatively  constant  number  of  packets 
in  transit.  In  other  words,  the  average  number  of  packets 
in  transit  will  remain  stable  during  the  simulation  run. 
If,  however,  the  cetwork  were  unstable,  the  number  of 
packets  in  transit  would  continue  to  increase  with  time. 
This  "blowing  up"  can  be  caused  from  links  becoming  satu¬ 
rated  and  thus  the  packets  entering  the  system  no  longer  are 
able  to  leave  at  a  steady  rate. 
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Fcr  tfce  lower  levels  of  traffic  intensity  in  which  the 
network  was  stable.  Little* s  Hesult  was  used  to  verify  the 
operation  c.f  the  model  itself.  Table  VI  gives  a  comparison 
cf  results  obtained  from  the  simulation  run  and  using 
Little's  Besult  in  which  the  close  agreement  between  both 
can  be  seen. 
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D.  BIHABIC  BOOTIIG  BFSOLTS 

During  the  dynamic  routing  test  phase,  those  parameters 
which  would  effect  tie  Yen  algorithm  performance  were  first 
identified.  The  next  step  was  to  isolate  one  parameter  at  a 
time  and  by  varying  that  value,  establish  its  contribution 
to  the  algorithm.  Finally,  after  arriving  at  a  ’'working” 
set  of  parameters  which  provided  acceptable  performance,  the 
network  was  subjected  to  a  wide  range  of  situations  in  order 
to  thoroughly  test  its  capabilities.  Of  particular 


interest,  was  the  algorithm’s  ability  to  handle  wide  ranges 
cf  traffic  intensities,  unbalanced  traffic  distributions, 
and  timing  errors  due  to  queued  updates  and  clock 
inaccuracies. 

The  piimary  paraieters  affecting  the  operation  of  the 
len  algorithm  are 

1.  Method  of  determining  the  Link  Weights 

2.  Frequency  of  Update  Generation 

These  points  are  not  unique  to  this  algorithm  but  are  actu¬ 
ally  ccmmcn  to  all  implementations  .of  distributed  routing 
algorithms. 

The  object  of  this  section  was  to  develop  a  system  of 
setting  link  weights  which  would  minimize  the  average  number 
of  packets  in  the  network.  In  doing  so  the  mean  packet 

delay  and  the  average  link  queue  size  should  also  be 

minimized. 

1 .  Determining  the  Link  Weight  Function 

Previous  research  conducted  at  UPS  has  used  a 
variety  cf  methods  for  determining  link  weights.  One  scheme 
presented  by  Heritsch  [Ref.  19]  derived  the  weight  by  taking 
the  average  queue  size  over  a  period  of  time.  Another 

method  used  by  Tritchler  [Ref.  27]  was  incorporated  within  a 


lime  Division  Multiple  Access  packet  radio  environment.  in 
this  case  the  links  were  provided  by  radio  transmissions. 
The  weight  of  a  link  was  chosen  to  be  a  function  of  both  the 
attenuation  of  the  radio  link  and  the  number  of  time  "slots" 
being  used  cn  the  lick. 

In  minimizing  the  average  number  of  packets  within 
the  system,  we  first  investigated  weighting  methods  which 
were  related  to  the  queue  size  of  a  link.  This  method 
appeared  attractive  due  to  its  simplicity  of  implementation 
and  the  direct  relationship  between  queue  size  and  packet 
delay. 

In  all  a  total  of  five  different  link  functions  were 
eventually  developed  and  tested.  They  were  produced  in  a 
progressive  fashion  with  the  final  method  proving  to  be 
significantly  better  than  the  other  four.  In  understanding 
the  characteristics  cf  each  method  and  the  rational  which 
led  to  Method  5,  the  simplest  of  the  link  weight  functions 
will  be  explained  first. 

a.  Method  1  :  Queue-Size-Now 

Method  1  assigns  the  weight  to  a  link  based  upon 
the  number  of  packets  which  are  in  the  link  queue  at  the 
time  cf  updating.  This  method  is  referred  to  in  the  pregram 
as  BY .QSIZE .NO H.  The  link  function  is  given  simply  as 
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W<I,J>  *  Q(l.j) 

where  W(I,J)  is  the  weight  cf  link  (I,J)  and  Q(I,J)  is  the 
size  of  link  queue  at  the  moment  of  updating.  The  simula¬ 
tion  was  run  and  the  results  are  given  in  Figure  5.3.  The 
results  indicate  that  even  with  the  higher  levels  of  traffic 
intensity  that  the  network  was  still  stable.  However,  as 
shown  in  Figure  5.4,  the  average  link  utilization  was 
approaching  saturation  for  these  high  levels.  This  high 
utilization  was  due,  in  part,  to  packets  taking  mere  heps 
per  trip  than  may  be  optimal.  This  is  caused  by  the  manner 
in  which  the  link  function  determines  the  link  weight. 

Since  tie  link  weight  function  uses  only  the 
queue-size-now,  the  best  paths  which  the  Yen  algorithm 
arrive  at  are  those  which  avoid  large  queues.  Therefore  a 
packet  may  take  a  long  trip  through  the  network  in  its 
attempt  tc  avoid  high  cost  trips.  These  longer  trips  trans¬ 
late  into  higher  link  utilizations  than  would  be  obtained 
through  a  least  hop  scheme.  By  minimizing  queue  size,  the 
average  number  cf  heps  per  packet  trip  increases  and  thus 
the  link  utilization  increases. 

Method  1  is  sensitive  only  to  what  is  happening 
in  the  network  at  the  present  moment.  The  next  two  methods 
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Number  Of  Packets  In  Transit 


PACKETS  IN  TRANSIT  VS.  TIME 


Simulation  Time  (secs) 


NETWORK  PARAMETERS 

Packet  transmission  time  **  0.0500  secs 
Update  transmission  time  —  0.00125  secs 
Node  update  interval  ™  0.5000  secs 
Avg  pkts  per  message  "  1.0 
DYNAMIC  ROUTING  WITH  METHOD  1  USED. 


Pkt  Gen  Rate 
□  =  100  pkts/sec 
O"  200  pkts/sec 
A*  300  pkts/sec 
+  “  400  pkts/sec 
X™  600  pkts/sec 


Figure  5.3  Hethod  1  Results 


Network  Utilization  Factor 


Figure  5.4  Hethod  1  Link  Utilization 
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were  developed  to  see  if  talcing  into  account  the  past 
condition  of  the  link  queue  would  favorably  effect  the 
performance. 

t.  Methods  2  and  3:  Queue  Size  Averaging 

Methods  2  and  3  were  developed  to  reduce  the 
high  utilization  which  appeared  to  be  caused  by  link  weights 
which  were  changing  too  rapidly  in  Method  1.  Instead  of 
looking  just  at  the  gueue  size  at  the  time  of  updating,  the 
average  gueue  size  ever  a  past  time  interval  was  observed. 
By  using  an  averaging  scheme,  it  was  felt  that  the  best 
paths  would  not  fluctuate  as  quickly  and  thus  excessively 
long  trips  would  be  reduced.  Both  methods  incorporated  a 
sliding  window  technique  over  which  the  average  queue  size 
was  evaluated  (Figure  5.5).  In  each  method  a  "sub-weight” 
was  calculated  fer  every  window  used  in  the  entire  period. 
The  time  duration  of  each  window  and  the  number  cf  total 
windows  used  were  both  parameters  in  the  simulation.  The 
link  weight  was  computed  as  the  average  of  the  sufc-weight 
values.  Methods  2  and  3  only  differed  in  the  manner  in 
which  the  sub-weights  were  determined.  Method  2  calculated 
the  sub-weights  as  being  the  gueue  size  at  the  start  of  the 
time  window.  This  method  is  referred  to  in  the  program  as 
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Height  depicts  Link  Queue  Size 


Figure  5.5  Hindowing  Technique 

BY. PAST . CSIZE.  Method  3  determines  sub-weights  as  the 
average  queue  size  for  the  time  window  and  is  referred  to  as 
EI.PAST.QAVG  in  the  program.  The  results  for  simulation 
runs  using  Methods  2  and  3  are  given  in  Figures  5.6  through 
5.9 

Both  methods  were  unstable  at  moderate  traffic 
intensities.  It  was  found  that  as  window  size  and  the 
number  of  windows  increased,  the  network  performance  deteri¬ 
orated.  The  use  of  past  average  queue  size  does  not  appear 
to  be  a  cseful  indication  cf  the  status  of  the  network  for 
use  in  best  path  determination. 
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PACKETS  IN  TRANSIT  VS.  TIME 


NETWORK  PARAMETERS 

Packet  transmission  time  —  0.0500  secs 
Update  transmission  time  “  0.00125  secs 
Node  update  interval  "  0.5000  secs 
Avg  pkts  per  message  *■  1.0 
DYNAMIC  ROUTING  WITH  METHOD  2  USED. 
Window  time  ™  0.375  secs 
No.  of  windows  ™  10 


Pkt  Gen  Rate 
□  “  100  pkts/sec 
O"  200  pkts/sec 
A"  300  pkts/sec 
+  *  400  pkts/sec 
X«  600  pkts/sec 
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Figure  5.6  Hethod  2  Hesults 


Network  Utilization  Factor 


UTILIZATION  FACTOR  VS.  TIME 


Simulation  Time  (secs) 


NETWORK  PARAMETERS 

Packet  transmission  time  ™  0.0500  secs 
Update  transmission  time  -  0.00125  secs 
Node  update  interval  —  0.5000  secs 
Avg  pkts  per  message  ■■  1.0 
DYNAMIC  ROUTING  WITH  METHOD  2  USED. 
Window  time  ■»  0.375  secs 
No.  of  windows  «  10 


Pkt  Gen  Rate 
□  *  100  pkts/sec 
0“  200  pkts/sec 
300  pkts/sec 
+  ~  400  pkts/sec 
X  «  500  pkts/sec 


Figure  5.7  Method  2  Link  utilization 
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UTILIZATION  FACTOR  VS.  TIME 


NETWORK  PARAMETERS 

Packet  transmission  time  “  0.0500  secs 
Update  transmission  time  ™  0.00125  secs 
Node  update  interval  ™  0.5000  secs 
Avg  pkts  per  message  “  1.0 
DYNAMIC  ROUTING  WITH  METHOD  3  USED. 
Window  time  *  0.375  secs 
No.  of  windows  ™  10 
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Figure  5.9  Method  3  Link  Utilization 
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c.  Hethcd  4:  Link  Utilization 

it  this  point,  due  to  the  lack  of  success  from 
the  queue  averaging  schemes,  a  link  weight  function  was 
selected  which  would  relate  directly  to  the  utilizaticn  of 
the  link.  Method  1,  though  stable,  produced  very  high 
utilization.  By  using  a  criterion  for  minimization  tased 
upon  link  utilization  it  was  hcped  that  stable  performance 
could  be  achieved. 

The  utilization  factor  of  a  link  is  the  ratio 


Utilizaticn 


Busy  Time 

Busy  Time  ♦  Idle  Time 


and  is  therefore  a  number  between  0  (no  traffic  on  link)  and 
1  (continuous  traffic  on  link).  Link  utilization  fcr  an 
M/M/1  queue  system  is  also  related  to  the  average  queue  size 
by 


E[n] 


Util 

1  -  Util 


where  E[n]  is  the  average 
plot  cf  this  relationship 
link  utilization  is  below 
in  the  link  queue  is  less 


number  of  packets  in  the  queue.  A 
is  given  in  Figure  5.10.  When  the 
0.5,  the  average  number  of  packets 
than  1.  For  utilization  factors 


greater  the  0.5,  the  number  increases  rapidly.  This  formula 


Figure  5.10  Average  Queue  Size  vs.  Utilization  Factor 

for  the  average  number  of  packets  as  a  function  of  utiliza¬ 
tion  was  used  for  the  link  weight  calculation.  •  However 
since  this  function  had  no  upper  bound,  a  maximum  value  was 
placed  upon  it  for  link  utilizations  greater  than  a  partic¬ 
ular  value. 

The  formulation  which  became  Method  4  has  a  link 
weight  function  cf 


S  <I,J) 


0  <  Otil  <  0. 95 

Util  >  0.95 


The  value  of  the  link  utilization  is  calculated  using  the 
same  windcw  scheme  used  in  Method’s  2  and  3.  The  value  of 
the  sub-weight  is  the  utilization  factor  of  the  link  over 
that  windcw  period.  The  sub-weights  are  averaged  over  the 
total  number  of  past  windows  used. 
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Method  4  is  the  first  scheme  presented  which  has 
some  of  tie  hybrid  features  discussed  in  Chapter  II.  This 
link  weight  function  behaves  differently  depending  upon  the 
link  utilization  within  the  network.  When  the  network  is 
lightly  leaded  such  that  link  utilizations  are  less  than 
0.5,  all  link  weights  will  have  values  between  1  and  2. 
This  means  that  the  unity  term  included  in  the  link  weight 
function  will  dominate  the  utilization  factor  term  and  thus 
the  routing  will  be  a  least  hop  system.  As  seen  previously, 
the  least  hop  scheme  is  an  excellent  best  path  choice  when 
the  system  is  lightly  loaded. 

When  traffic  intensity  increases  such  that  link 
utilizations  increase  above  0.5,  the  link  weight  function 
will  be  dominated  by  this  term  and  the  best  paths  will  be 
chosen  tc  avoid  highly  utilized  links.  The  addition  of  the 
unity  term  has  in  effect  provided  a  stabilizing  effect  which 
keeps  tie  link  weights  from  churning  or  varying  rapidly 
under  light  traffic  conditions.  Results  of  Method  4  simula¬ 
tions  are  given  in  Figure  5.11.  This  plot  is  guite  similar 
to  the  Method  1  results.  However,  the  average  link  utiliza¬ 
tion  seen  in  Pigure  5.12  is  greatly  reduced  using  Method  4. 


Number  Of  Packets  In  Transit 


Figure  5.11  Method  4  Results 


Network  Utilization  Factor 


UTILIZATION  FACTOR  VS.  TIME 


NETWORK  PARAMETERS 

Packet  transmission  time  =*  0.0500  Secs 
Update  transmission  time  "  0.00125  secs 
Node  update  interval  *■  0.5000  secs 
Avg  pkts  per  message  "  1.0 
DYNAMIC  ROUTING  WITH  METHOD  4  USED. 
Window  time  "  0.375  secs 
No.  of  windows  «  10 


Pkt  Gen  Rate 
□  =  100  pkts/sec 
O"  200  pkts/sec 
A"  300  pkts/sec 
+  =  400  pkts/sec 
X  "  500  pkts/sec 


Pigure  5.12  Method  4  Link  Utilization 
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E.  THE  "COMBINATION"  LINK  HEIGHT  FUNCTION 


In  the  proceeding  paragraphs,  two  schemes  were  found 
which  provided  stable  results.  Method  1  determined  link 
weights  based  upon  the  queue  size  at  the  moment  of  updating 
while  Method  4  calculated  link  weights  as  a  function  of 
average  link  utiization.  Method  5  was  developed  as  a  linear 
combination  of  these  two  methods.  The  link  weight  function 
used  in  this  "combination"  scheme  is 

Util 

W(I,J)  =  [  QU  .FACT  *  Q  (I,J)  3  ♦  1  ♦  - 

1  -  Util 

QU. FACT  is  the  Queue  Scaling  Factor  used  to  observe  the 
effect  of  changing  the  relative  influence  of  the  term  asso¬ 
ciated  with  the  queue -size- now  to  the  utilization  term.  The 
same  window  operation  was  used  in  this  formula  as  appeared 
in  Method  4.  In  addition,  the  same  upper  bound  was  placed 
on  this  term  as  was  given  in  Method  4. 

The  simulation  . results  using  Method  5,  which  is  called 
the  RHO. CCMEINE  method  in  the  program,  is  given  in  Figures 
5.13  through  5..  16.  QU.FACT  equalled  unity  during  these 
runs.  Latter  sections  present  the  effects  of  variations  in 
QU.FACT  on  algorithm  performance.  As  seen  from  the  plots, 
the  result  of  combining  these  methods  has  vastly  improved 
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Number  Of  Packets  In  Transit 


Network  Utilization  Factor 


UTILIZATION  FACTOR  VS.  TIME 


Simulation  Time  (secs) 


NETWORK  PARAMETERS 

Packet  transmission  time  9  0.0500  secs 
Update  transmission  time  9  0.00125  secs 
Node  update  interval  9  0.5000  secs 
Avg  pkts  per  message  9  1.0 
DYNAMIC  ROUTING  WITH  METHOD  5  USED. 
Window  time  9  0.375  secs 
No.  of  windows  9  10 


Pkt  Gen  Rate 
□  9  100  pkts/sec 
O  9  200  pkts/6ec 
A9  300  pkts/sec 
+  *  400  pkts/sec 
X9  500  pkts/sec 


Figure  5.14  Method  5  Link  Utilization  I 
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Simulation  Time  (secs) 


NETWORK  PARAMETERS 

Packet  transmission  time  =»  0.0500  secs 
Update  transmission  time  *  0.00125  secs 
Node  update  interval  ™  0.5000  secs 
Avg  pkts  per  message  •  1.0 
DYNAMIC  ROUTING  WITH  METHOD  5  USED. 
Window  time  *■  0.375  secs 
No.  of  windows  ™  10 


Pkt  Gen  Rate 
“  400  pkts/sec 
■*  500  pkts/sec 
—  550  pkts/sec 
m  575  pkts/sec 

*  600  pkts/sec 
"  625  pkts/sec 
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*  700  pkts/sec 


Figure  5. 1*6  Method  5  Link  Utilization  II 
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Avg  No.  of  Pkts  in  Transit 


Figure  5.17  Lick  Height  Methods  :  Stable  Performance 
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the  performance  of  the  algorithm.  Figure  5.  17  compares  the 
performance  *of  the  three  tested  link  weight  functions  which 
produced  stable  network  performance.  The  dramatic  improve¬ 
ment  achieved  with  the  final  method  can  be  readily  seen. 
These  results  indicate  that  by  linearly  combining  Methods  1 
and  h,’  the  best  of  both  worlds  in  a  link  weight  function  is 
achieved. 

The  explanation  as  to  why  Method  5  is  so  successful 
seems  to  center  about  two  ideas  which  correspond  to  the  two 
terms  of  the  function.  The  first  is  the  link  weight  term 
involving  the  recent  history  cf  utilization.  This  factor 
can  be  viewed  as  providing  as  estimate  cf  conditions  at 
nodes  in  nearby  areas  of  the  network  without  actually 
receiving  direct  information  from  those  nodes.  This  prin¬ 
ciple  can  test  be  understood  through  an  example.  Suppose 
that  a  link  has  been  heavily  utilized  with  a  utilization 
factor  for  the  current  window  period  of  0.75.  Additionally 
at  the  mcment  of  best  path  calculation  the  link  queue  has 


just  emptied  its  last  packet. 


If  the  link  weight  function 


is  based  only  upon  the  current  queue  size  then  the  weight  of 
the  link  would  be  minimal.  However#  the  terminating  node  of 
the  link  may  now  be  "backed  up"  with  traffic  due  tc  the 


V 


previous  period  cf  high  utilization.  By  incorporating  link 
utilization  into  the  weighting  function,  the  conditions  at 


the  terminating  nodes  for  the  links  can  be  estimated.  This 
ability  tc  see  a  little  way  "over  the  horizon"  enables  the 
routing  algorithm  which  uses  link  utilization  to  steer 
traffic  away  from  areas  which  have  recently  received  high 
volumes  cf  traffic. 

The  second  idea,  which  adds  "balance"  to  the  previous 
point,  is  that  looking  at  only  the  link  utilization  does  not 
take  into  account  the  immediate  impact  which  traffic  origi¬ 
nating  from  a  node  has  upon  best  path  routing.  when  link 
weights  are  determined  from  utilization  alone,  situations 
can  occur  where  links  of  similar  usage  can  suddenly  have 
very  different  queue  sizes  due  to  the  origination  of 
messages  at  the  node.  As  an  example,  suppose  that  two 
outgoing  links  of  a  node  have  had  utilization  factors  of 
0.25  ever  the  current  window  period  and  presently  their  link 
queues  are  empty.  At  this  point  the  node  accepts  20 
messages  which  it,  being  the  originator,  places  into  the 
queue  of  one  of  the  links  based  upon  the  routing  table.  Now 
a  length  cf  time  proportional  to  the  window  period  will  pass 
before  the  utilization  of  this  link  becomes  different  enough 
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so  as  to  cause  a  best  path  change.  This  time  lag  is  due  to 
the  effect  of  using  a  calculation  based  upon  an  average  over 
a  period  of  time.  Ey  including  the  term  related  tc  queue- 
size-now  in  the  link  weight  function  of  Method  5,  the  link 
weights  can  reflect  the  activity  of  a  node  as  an  originator 
cf  traffic. 

Method  5  has  seme  important  distinctions  from  Chou’s 
hybrid  link  weight  function  mentioned  in  Chapter  II.  Chou's 
quadratic  function  used  only  the  queue  size  term.  Method  5, 
on  the  other  hand,  employs  the  additional  term  related  to 
the  immediate  past  history  of  utilization  of  the  links.  It 
is  this  ccmtination  cf  terms  which  appears  to  give  the  algo¬ 
rithm  such  a  useful  estimation  of  the  network  status. 

1.  Be  suits  of  Varying  Window  Period 

The  link  utilization  term  used  in  the  link  weight 
function  of  Method  5  was  calculated  over  an  interval  of  time 
called  the  window  period.  For  this  discrete  simulation, 
since  updates  occurred  at  random  times,  the  window  period 
was  modeled  such  that  during  operation  it  appears  as  a 
continuously  sliding  time  window.  To  accomplish  this 
continuously  sliding  effect,  the  total  window  period  was 
divided  into  a  number  of  smaller  sized  windows.  If  ten 


small  windows  were  chosen  in  the  previous  example  to  model 
the  one  second  window  period,  each  small  window  would  be  0.1 
seconds  long.  Therefore  every  0.1  seconds  the  link  utiliza¬ 
tions  would  have  been  computed  at  the  node  with  only  the  10 
most  recent  windows  teing  used  during  updating. 

The  effects  cf  varying  the  window  period  is  shown  in 
Figure  5.18.  The  algorithm  performance  improved  as  the 
window  period  (which  equalled  the  product  of  the  number  of 
windows  and  the  window  size)  increased  to  a  certain  point 
after  which  lengthening  the  period  did  not  achieve  substan¬ 
tial  performance  improvements.  When  a  smaller  window  was 
used,  a  greater  number  of  windows  were  required  to  achieve 
the  same  performance  as  with  larger  windows.  However,  the 
total  window  period  required  was  shorter  than  when  using  the 
larger  windows.  This  is  especially  noticeable  from  the  plot 
in  the  case  where  13  windows  cf  duration  0.125  seconds  had 
the  same  average  number  of  packets  in  transit  as  4  windows 
of  duration  0.675  seconds.  The  total  window  period  for  the 
shorter  windows  was  1.625  seconds  while  the  longer  windows 
had  a  total  period  of  2.7  seconds.  For  the  remainder  of  the 
testing  10  windows  of  length  0.375  seconds  were  used 
resulting  in  a  total  window  period  of  3.75  seconds. 
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VARYING  THE  SIZE  AND  NO.  OF  WINDOWS 


Number  of  Windows 


NETWORK  PARAMETERS 

Packet  transmission  time  =  0.0500  secs 
Update  transmission  time  «  0.00125  secs 
Node  update  interval  ™  0.5000  secs 
Avg  pkts  per  message  ■■  1.0 
Dynamic  Routing  with  Method  5  used. 
Virtual  Circuits  were  not  used. 
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2.  Results  of  Varying  the  Queue  Factor 

The  Queue  Factor  is  the  scaling  multiplier  for  the 
queue-size- now  term  in  Method  5.  By  varying  this  value, 
either  the  gueue-size-now  tern  or  the  utilization  tern  can 
te  emphasised.  When  the  Queue  Factor  is  set  to  zero  the 
queue  size  term  drops  out  resulting  in  simply  Method  4.  By 
the  same  tcken,  as  the  Queue  Factor  is  made  large,  a  Method 
1  link  weight  function  occurs  with  the  utilization  term 
being  •’swamped"  by  the  queue-size  term. 

Figure  5.19  shows  the  network  performance  of  the 
test  network  when  the  Queue  Factor  was  varied  from  0  to  4. 
As  expected  the  results  with  the  Queue  Factor  equal  to  zero 
are  identical  tc  these  of  Method  4.  Similarly  as  Queue 
Factor  increases,  the  network  performance  begins  to  degrade 
to  that  obtained  using  Method  1.  The  interesting  result  is 
the  very  substantial  improvement  in  performance  achieved 
when  the  Queue  Factor  had  values  near  unity. 

This  result  provokes  a  question  concerning  the 
sensitivity  of  the  Queue  Factor  term  upon  the  Method  5  link 
weight  function.  Since  Queue  Factor  provides  the  balance 
between  the  gueue  size  and  utilization  term,  its  sensitivity 
was  tested  in  the  following  way. 
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Avg  No.  of  Pkts  in  Transit 


VARYING  THE  VALUE  OF  QUEUE  FACTOR 


NETWORK  PARAMETERS 

Packet  transmission  time  =  0.0500  secs 
Update  transmission  time  «  0.00125  secs 
Node  update  interval  "  0.5000  secs 
Avg  pkts  per  message  ™  1.0 
Dynamic  Routing  with  Method  5  used. 
Window  time  “  0.375  secs 

No.  of  windows  ™  10 

Virtual  Circuits  were  not  used. 


Figure  5.19  Varying  the  Queue  Pactor 
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If  one  were  tc  vary  the  length  of  a  message  packet, 
the  same  number  of  packets  traveling  over  a  link  would  cause 
different  utilization  factors.  By  the  same  token,  if 
different  packet  sizes  were  used  and  the  packet  generation 
rate  into  the  network  was  properly  varied,  one  could  main¬ 
tain  a  particular  average  link  utilization  for  simulation 
runs.  This  was  the  approach  used  in  testing  the  sensitivity 
of  the  Queue  Pactor  term.  Three  different  packet  sizes  were 
used  such  that  their  transmission  times  were  0.0125,  0.0500 
and  0.2000  seconds.  The  packet  generation  rate  was  set  so 
that  the  average  link  utilization  was  the  same  for  each 
packet  size.  In  this  manner  the  utilization  term  is  held 
constant  while  the  queue  size  term  is  allowed  to  take  on 
different  values. 

The  results  when  the  average  network  link  utiliza¬ 
tion  was  adjusted  to  C.50  and  0.80  are  given  in  Figures  5.20 
and  5.21.  For  both  these  results  the  average  number  of 
packets  within  the  network  was  normalized  so  that  a  single 
plot  could  show  the  effects.  In  the  case  where  utilization 
was  at  0.50  the  network  performance  improved  dramatically  as 
the  Queue  Factor  became  greater  than  zero.  The  performance 


with  the  shorter  packet  of  length  0.0125  continued  to 
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Queue  Factor 


NETWORK  PARAMETERS 

Update  transmission  time  =  0.00125  secs 
Node  update  interval  ■*  0.5000  secs 
Avg  pkts  per  message  "*  1.0 
Dynamic  Routing  with  Method  5  used. 
Window  time  ™  7  *  pkt.xmt.time 
No.  of  windows  ■■  10 

Avg.  Link  Utilization  was  50.0  %. 


Figure  5.20  Cueue  Factor  :  0.50  Otilization 
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Normalized  Traffic  Intensity 


VARYING  THE  VALUE  OF  QUEUE  FACTOR 


NETWORK  PARAMETERS 

Update  transmission  time  =  0.00125  secs 
Node  update  interval  ™  0.5000  secs 
Avg  pkts  per  message  "  1.0 
Dynamic  Routing  with  Method  5  used. 
Window  time  «  7  *  pkt.xmt.time 
No.  of  windows  *  10 

Avg.  Link  Utilization  was  80.0  %. 


Figure  5.21  Cueue  Factor  :  0.80  Utilization 


improve  yet  was  beginning  to  level  off.  The  perfomance  of 
the  longer  packets  had  both  started  to  degrade  as  the  Queue 
Factor  reached  a  value  of  4.  When  the  utilization  was 
increased  to  0.80  the  performance  with  all  three  packet 

I 

sizes  again  improved  as  Queue  Factor  became  greater  than 
zero.  Here  it  is  apparent  that  the  shorter  packet  perform¬ 
ance  degraded  rapidly  as  the  Queue  Factor  became  greater 
that  unity. 

These  results  indicate  that  the  Queue  Factor  can  be 
changed  to  match  a  given  network  situation  to  a  particular 
level  cf  performance.  In  addition,  when  link  capacities  are 
large  in  terms  of  the  number  of  packets  per  second  which  can 
be  transmitted  over  them,  then  the  Queue  Factor  is  best  kept 
small  so  as  not  to  overpower  the  utilization  term.  In  the 
remainder  of  the  simulation  the  Queue  Factor  was  set  to 
unity  which  produced  satisfactory  performance  for  the  packet 
transmission  time  of  0.0500  seconds. 

3.  Results  of  Varying  Node  Opiate  Interval 

The  node  update  interval  is  the  time  between  consec¬ 
utive  updates  being  generated  by  a  single  node.  The  ncde 
update  frequency  is  the  inverse  of  this  interval.  It  would 
appear  that  by  reducing  the  time  interval  between  updates. 
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the  algorithm  would  perform  more  effectively  since  best 
paths  would  reflect  changes  in  network  conditions  more 
rapidly.  However  problems  occur  when  the  increased  link 
utilization  due  to  update  messages  begins  to  interfere  with 
normal  message  traffic. 

As  discussed  before,  the  link  utilization  caused  by 
update  messages  is  a  function  of  the  number  of  nodes  in  the 
network,  the  update  interval  and  the  update  transmission 
time.  In  the  thirteen  node  test  network  where  the  update 
interval  is  0.5  seconds  and  the  update  transmission  time  is 
0.00125  seconds,  the  utilization  per  link  due  to  this  over¬ 
head  is  only  0.0  1625.  Such  a  low  value  does  not  "load  down" 
the  network  substantially  enough  to  interfere  with  regular 
message  transmissions.  This  is  demonstrated  in  Figure  5.22, 
which  indicates  that  performance  improves  as  the  frequency 
of  updates  increases.  The  size  of  an  update  packet,  though, 
is  relatively  small  being  only  1/40th  the  size  of  a  message 
packet.  This  small  update  is  in  keeping  with  the  very 
simple  information  which  the  Yen  algorithm  requires  ar.d  is 
by  no  means  unrealistic.  S^nce  the  link  utilization  is 
proportional  to  the  number  of  nodes  in  the  network,  however, 

A 

the  performance  of  the  network  under  conditions  of  higher 
overhead  must  still  be  evaluated. 
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VARYING  THE  TIME  INTERVAL 
BETWEEN  NODE  UPDATE  TRANSMISSIONS 


Node  Update  Interval  (secs) 


NETWORK  PARAMETERS 

Packet  transmission  time  **  0.0500  secs 
Update  transmission  time  ■*  0.00125  secs 
Avg  pkts  per  message  ■■  1.0 
Dynamic  Routing  with  Method  5  used. 
Window  time  ■■  0.375  secs 

No.  of  windows  “  10 

Virtual  Circuits  were  not  used. 


One  'way  to  produce  a  situation  where  update  overhead 
becomes  significant  is  simply  to  increase  the  size  of  the 
network.  However,  due  to  the  increased  computing  time  this 
answer  was  not  chosen  initially.  The  solution  selected  was 
to  increase  the  size  of  the  update  packet  by  a  factor  of  6. 
The  new  update  transmission  time  was  0.00750  seconds  and 
this  packet  was  now  only  1/15the  the  size  of  the  message 
packet.  Figure  5.23  gives  the  network  performance  using  the 
larger  update.  For  conditions  of  relatively  high  traffic 
intensity,  the  effects  of  the  update  transmissions  substan¬ 
tially  reduces  the  performance  of  the  network.  The  average 
link  utilization  increases  as  the  frequency  of  update  trans¬ 
missions  increases.  Figure  5.24  shows  that  when  the  packet 
generation  was  500  packets  per  second  and  short  update 
intervals  were  used,  the  entire  network  became  saturated. 
The  actual  link  utilization  from  overhead  traffic  is  given 
in  Figure  5.25.  The  calculated  link  utilization  plotted  in 
the  figure  was  obtained  using  the  relationship  developed  in 
Chapter  III  which  stated  that 

link  Otilf  updates  ]  =  (N  /  2T) 0. XMN .TIME 

where  N  was  the  number  of  ncdes  and  T  was  the  time  interval 
between  consecutive  update  transmissions  by  a  node.  The 


VARYING  THE  TIME  INTERVAL 
BETWEEN  NODE  UPDATE  TRANSMISSIONS 


Node  Update  Interval  (secs) 


NETWORK  PARAMETERS 

Packet  transmission  time  =  0.0500  secs 
Update  transmission  time  *■  0.00750  secs 
Avg  pkts  per  message  “  1.0 
Dynamic  Routing  with  Method  5  used. 
Window  time  "  0.375  secs 

No.  of  windows  "  10 

Virtual  Circuits  were  not  used. 


Figure  5.23  Node  Opiate  Interval  :  High  Overhead 


VARYING  THE  TIME  INTERVAL 
BETWEEN  NODE  UPDATE  TRANSMISSIONS 


Pkt  Gen  Rate 
□  "  100  pkts/sec 
O"  300  pkts/sec 
A  —  500  pkts/sec 


Node  Update  Interval  (secs) 


NETWORK  PARAMETERS 

Packet  transmission  time  =  0.0500  secs 
Update  transmission  time  «■  0.00750  secs 
Avg  pkts  per  message  ■*  1.0 
Dynamic  Routing  with  Method  5  used. 
Window  time  *  0.375  secs 

No.  of  windows  -  10 

Virtue!  Circuits  were  not  used. 


Figure  5.24  Hode  Update  Interval  :  Total  Link  Utilization 


VARYING  THE  TIME  INTERVAL 
BETWEEN  NODE  UPDATE  TRANSMISSIONS 


Node  Update  Interval  (secs) 


NETWORK  PARAMETERS 

Packet  transmission  time  =  0.0500  secs 
Update  transmission  time  *  0.00750  secs 
Avg  pkts  per  message  "  1.0 
Dynamic  Routing  with  Method  5  used. 
Window  time  ™  0.375  secs 

No.  of  windows  ™  10 

Virtual  Circuits  were  not  used. 


Figure  5.25  Bode  Update  Interval  :  Update  Link  Utilization 
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agreement  between  the  calculated  value  and  the  simulation 


results  is  very  good.  This  not  only  provides  another  vali¬ 
dation  methcd  for  the  simulation  program  itself  but  it  also 
verifies  an  analytical  methcd  for  estimating  the  utilization 
overhead  for  a  network. 

F.  TESTIHG  THE  BOOil  TEH  k  LGOBITHM 

The  basic  set  of  parameters  for  the  nodal  Yen  algorithm 
have  been  established  from  the  previous  sections.  The 
window  period,  Cueue  Factor  and  node  update  interval  were 
selected  based  upon  simulations  using  uniformly  distributed 
traffic  intensities  ard  a  highly  symmetric  network  topology. 
The  second  phase  of  this  research  centers  around  the  test 
and  evaluation  of  the  basic  algorithm  under  a  variety  of 
different  conditions.  Specifically,  the  performance  of  the 
algorithm  under  the  following  conditions  is  sought: 

1.  Timing  Errors 

2.  Geometrically  Distributed  Message  Lengths. 

3.  Unbalanced  Traffic  Patterns. 

4.  Datagram  and  Virtual  Circuits. 

In  this  way,  it  can  be  determined  whether  cr  not  routing 
algorithm  parameters  selected  while  using  uniform  traffic 
distributions  will  provide  acceptable  network  performance 
under  different  circuistances. 
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1.  Timing  Errors 

A  major  issue  in  determining  the  applicability  of 
these  time-dependent  routing  protocols  is  how  sensitive  the 
test  path  selection  is  to  timing  errors  in  the  arrival  of 
update  messages.  It  is  obvious  that  if  update  messages  do 
not  arrive  when  they  are  supposed  to  that  the  receiving  ncds 
will  incorrectly  calculate  the  Update  Reception  Weight.  The 
question  is  how  wrong  the  arrival  time  of  the  update  can  be 
before  the  best  path  selection  becomes  incorrect .  Insight 
as  to  the  magnitude  of  this  timing  error  can  be  obtained  by 
reviewing  hew  the  tentative  time  for  update  transmission  is 
calculated. 

The  calculation  of  the  update  transmission  time 
involved  dividing  the  tentative  shortest  path  distance  by  C. 

T[?  <0,K)  ]  =  F  (J ,  K)  /  C 

Since  C  is  chosen  to  equal  ths  inverse  of  the  time  required 
to  transmit  an  update  (U.  X  MN . TIME) ,  this  is  equivalent  to 
multiplying  the  path  distance  by  the  update  transmission 
time . 

T[  ?  (J  ,  K )  j  =  F(J,K)  *  U.  XMN . TIME 
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The  path  distance  includes  the  Reverse  Link  Height  which  is 
computed  using  the  combination  link  weight  function. 

Otil 

H  (I,  J)  »  [QO.FACT  *  Q  (I ,  J)  ]  ♦  1  ♦  - - ---- 

The  link  weight  is  constrained  to  be  greater  than  or 
equal  to  cne  and  therefore  the  minimum  tine  interval  after 
which  a  node  can  send  its  own  update  transmission  upon 
receiving  one  is  U.XHN.TIME  seconds.  Using  this  fact  the 
maximum  speed  at  which  updates  can  "propagate”  through  a 
network  can  be  determined.  Maximum  propagation  speed  will 
cccur  when  link  weights  are  minimum  and  thus  the  calculated 
update  transmission  delay  is  only  O.XMN.TIME  seconds.  An 
update  originating  at  time  0  will  reach  a  node  that  is  K 
hops  distant  (via  least  hep  path)  in  (2K  -  1)  U.XMN.TIME 
seconds.  If  the  path  were  one  hop  longer  the  additional 
time  delay  would  be  (2) 0 .XH N. TIME  seconds. 

The  size  of  the  timing  error  required  to  cause  the 
incorrect  selection  within  a  uniform  weight  least  hep  scen¬ 
ario  is  twice  the  time  reguired  to  transmit  an  update 
packet.  This  gives  an  indication  of  the  magnitude  of  timing 
errors  which  the  algorithm  can  function  with  without  miscal¬ 
culating  test  paths.  The  next  step  is  to  look  at  possible 
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sources'  cf  update  arrival  timing  errors  and  their  magnitude 
in  relationship  to  O.XHN.TIHE. 

A  possible  source  of  timing  errors  is  the  micropro¬ 
cessor  clock  used  by  the  algorithm.  These  errors  originate 
from  the  discrete  nature- of  the  clock  in  which  all  events 
performed  by  the  node  (such  as  the  transmission  of  messages) 
cccur  only  at  the  beginning  of  a  clock  period.  Errors 
develop  when  a  computed  transmission  time  for  an  update 
message  falls  in  the  middle  of  a  clock  period.  The  actual 
transmission  time  of  that  update  will  be  delayed  until  the 
beginning  of  a  new  period.  It  follows  that  the  shorter  the 
clock  period,  the  smaller  the  errors  due  to  delays  in  update 
transmissions.  The  upper  bound  on  the  size  of  the  clock 
interval  would  be  the  bit  interval  of  the  transmitted  data. 
Since  the  bit  interval  is  much  smaller  than  the  time 
required  to  transmit  an  update,  performance  degradation  due 
to  these  errors  is  net  expected  to  occur.  Through  simula¬ 
tion*  the  accuracy  of  this  prediction  can  be  determined. 

Ey  modeling  the  simulation  program  such  that  the 
time  for  message  transmissions  occurred  only  at  the  start  of 
a  clock  period,  the  effects  on  performance  due  to  finite 
clock  periods  could  be  analyzed.  The  simulation  clock  of 


SIRSCEIPT  is  a  real  double  precision  variable  (TIBE.V)  and 
has  a  discrete  period  of  10 **-16  seconds.  For  all  practical 
natters,  the  sinulation  tine  appears  continuous.  The  data 
transmission  rate  for  the  test  network  was  20000  bits  per 
second  which  meant  the  bit  interval  was  0.00005  seconds. 
The  sinulation  was  tested  using  "discrete”  clocks  whose 
periods  ranged  from  0.000001  to  0.000050  seconds. 

From  the  results  of  the  simulation  runs  (Figure 
5.26),  effects  due  to  the  clock  periods  selected  did  not 
substantially  change  the  performance  of  the  algorithm. 
Errors  in  update  transmission  times  of  up  to  one  clock 
period  are  not  large  enough  to  change  the  best  path  calcula¬ 
tions.  The  relative  insensitivity  of. the  algorithm  to  small 
random  tiling  errors  is  indeed  a  positive  feature  ir.  its 
operating  characteristics. 

The  second  source  of  timing  errors  in  the  arrival  of 
update  messages  is  queueing  delays.*  The  update  insertion 
technique  eliminates  queueing  delays  which  may  have  been 
caused  from  regular  message  traffic.  However,  updates 
cannot  he  inserted  within  updates  and  therefore  queueing 
delays  dc  occur.  If  two  updates  attempt  to  travel  over  the 
same  link  at  the  same  time,  one  will  be  delayed  U.XMN.TIME 
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RESULTS  IN  USING  DISCRETE  CLOCKING 
FOR  ALL  NETWORK  TIMING 


Pkt  Gen  Rate 
□  “100  pkts/sec 
O  "300  pkts/sec 
A"600  pkts/sec 


10  16  20  25  30  35  40 

Clock  Interval  (10**-6  secs) 


NETWORK  PARAMETERS 

Packet  transmission  time  *  0.0500  secs 
Update  transmission  time  —  0.00125  secs 
Node  update  interval  ■  0.5000  secs 
Avg  pkts  per  message  "  10 
Dynamic  Routing  with  Method  5  used. 
Window  time  ™  0.375  secs 

No.  of  windows  "  10 

Virtual  Circuits  ware  not  used. 


Figure  5.26  Varying  the  Clock  Interval 


seconds.  Delays  associated  with  queueing  are  related  tc  the 
update  transmission  time  and  thus  can  cause  changes  in  best 
path  calculations.  The  issue  to  be  determined  is  whether 
the  frequency  of  update  '’collisions”  is  such  that  network 
performance  is  substantially  affected. 

The  effects  cf  update  collisions  are  demonstrated  by 
using  twc  simulation  models.  Both  are  identical  except  that 
one  version  does  not  use  update  queues.  This  model  allows 
updates  tc  travel  "transparently”  through  the  network 
without  collisions.  In  fact  this  simpler  (and  earlier) 
version  isolated  update  traffic  from  regular  message 
traffic.  The  model  was  developed  under  the  assumption  that 
the  probability  of  update  collisions  was  small  and  total 
link  utilization  due  to  update  traffic  was  also  small.  The 
second  and  more  realistic  model  (which  is  used  throughout 
this  work)  employs  update  queues  so  that  update  collisions 
do  result  in  queueing  delays. 

Table  VII  gives  the  summary  of  results  when  both 
methods  were  used  on  the  test  network  with  uniform  traffic 
distributions.  The  node  update  interval  was  0.5  seconds. 
Network  parameters  were  identical  for  both  simulation 
versions.  The  table  uses  wQ  and  woQ  to  indicate  the  final 


TABLE  YII 

Effects  of 

Update  Queueing  Delays 

|  Pkt.  Gen.  Bate 

j  (pkts/sec) - >  100 

2  00 

4  00  | 

•P  a  1  T  ^  r\k 

wo  Q 

w£  wo£ 

12 

WOQ 

Util. 

.1*76 

.155 

.321  .  305 

.646 

.633 

link  Otil. 
from  Updates 

.021 

— 

.019 

.017 

-- 

Mean  Update 
Queue  Size 

.0002 

— 

.0001  — 

.0001 

— 

Max.  Update 
Queue  Size 

1 

-- 

2 

1 

— 

Avg.  Humber 
of  Packets 
in  Network 

10.6 

10.  3 

24.1  23.0 

98.7 

97.  5 

1 

version  (with 

Queue) 

and 

the  earlier 

version 

(without 

Queue).  The  results  indicate  the  difference  in  network 
performance  between  the  two  methods  is  negligible.  This 
seems  tc  fce  due  in  part  to  the  very  low  values  for  both  the 
mean  and  maximum  update  queue  sizes  during  the  simulation. 
Very  few  update  collisions  actually  did  occur  and  thus  erro¬ 
neous  best  path  calculations  were  not  prevalent. 

During  all  remaining  phases  of  simulation  testing, 
after  data  was  compiled  using  the  final  model,  the  earlier 
version  was  also  run.  The  maximum  size  for  an  update  gueue 
during  these  runs  was  three  packets  with  the  mean  value 


regaining  quite  low.  In  all  cases  tested,  the  difference 
between  network  performance s  was  slight.  Prom  these  results 
it  appears  that  the  performance  of  this  time-dependent 
routing  protocol  in  networks  exhibiting  update  delays  from 
both  "discrete"  clocks  and  queueing  is  not  only  acceptable, 
tut  very  near  that  obtained  without  these  errors. 

2.  Geometrically  Distributed  Message  Lengths 

Message  traffic  entering  the  network  has  been 
modeled  as  having  an  arrival  rate  based  upon  a  Poisson 
process.  In  using  the  Poisson  distribution,  the  rate  of 
arrival  is  "  X "  messages  per  second  and  thus  the  average 
interarrival  time  between  messages  is  1/  X  seconds,  so  far, 
though,  the  length  of  all  messages  has  only  been  one  packet. 
In  operating  packet-switched  networks,  •  messages  occur  in 
different  lengths  and  must  be  split  into  a  number  of  packet 
sized  units  prior  to  transmission. 

From  Chapter  IV  we  considered  the  case  where 
multiple  packet  messages  had  a  geometric  distribution  for 
their  lengths.  Figure  5.27  gives  the  results  of  simulation 
runs  using  geometrically  distributed  message  lengths.  The 
average  number  of  packets  per  message  ranged  from  1  tc  20. 
The  results  show  for  a  fixed  packet  generation  rate  that  the 
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VARYING  THE  AVERAGE  NUMBER  OF 
PACKETS  PER  MESSAGE  USING  A 
GEOMETRIC  DISTRIBUTION 


NETWORK  PARAMETERS 

Packet  transmission  time  =*  0.0500  secs 
Update  transmission  time  »  0.00125  secs 
Node  update  interval  "  0.5000  secs 
Dynamic  Routing  with  Method  5  used. 
Window  time  "  0.375  secs 
No.  of  windows  *■  10 
VIRTUAL  CIRCUITS  WERE  NOT  USED. 


Figure  5.27  Geometrically  Distributed  Hessage  Lengths 

198 


1 

- 

i 


vo 

ui 


average  number  of  packets  in  the  network  increased  as  the 
average  message  length  increased.  By  applying  the  results 
obtained  frca  the  P-K  formula,  this  increase  is  known  to  be 
characteristic  whenever  a  geometric  distribution  is  used  for 
the  message  length.  The  increase  is  not  due  to  a  breakdown 
in  the  routing  algorithm  as  might  otherwise  have  been 
suspected  had  this  aralytical  result  not  been  applied. 

The  P-K  formula  stated  that  the  average  number  of 
packets  in  an  H/G/1  queue  was 

.  .  XD/F  (  XD/p2)  (2  -  p) 

E(  I]  - -  ♦  - - - 

2  2(1  -  XD/p) 

..  .  where  X  *  Message  arrival  rate  in  pkts/sec 

D  =  Packet  transmission  time  in  seconds 
p  *  1  /  Average  message  length  in  packets 

Since  the  simulation  involves  a  network  of  queues,  the  P-K 
formula  is  used  to  analyze  the  behavior  of  the  network  when 
geometrically  distributed  message  lengths  are  used  rather 
than  solve  for  E(L]  exactly.  This  is  permissable  since  the 
network  is  in  an  equilibrium  state  with  no  saturated  links. 
Eurke  [Bef.  26]  shewed  that  in  such  a  situation  where 
traffic  entering  a  system  is  Poisson,  the  output  traffic  is 
also  Poisson.  The  P-K  formula  can  thus  be  used  to  provide 
insight  into  the  behavior  of  a  network  of  queues. 
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The  factor  XD/p  corresponds  to  the  link  utilization 
and  as  such  is  less  than  or  egual  to  one.  The  second  term 
containing  p2  will  dominate  the  value  of  E[  L]  when  X  D  is 
fixed  and  p  <<  1.  E[L]  will  generally  increase  as  the 
sguare  of  the  average  message  length  in  packets.  Therefore 
a  doubling  cf  the  average  message  length  will  result  in  an 
approximate  guadrupling  of  the  average  number  of  packets  in 
the  network.  From  the  simulation  results,  the  behavior  of 
the  network  using  fixed  message  arrival  rates  and  varying 
values  of  p  can  be  analyzed  to  see  if  this  characteristic 
relationship  is  evident. 

Table  VIH  shows  the  average  number  of  packets  in 
the  network  using  fixed  message  rates  while  varying  the 
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average  message  length  in  packets.  When  the  average  message 
length  doubled  from  5  to  10  pkts/msg,  the  average  number  of 
packets  in  the  network  (E[n])  increased  3.93  and  4.43  times 
for  the  10  and  20  isgs/sec  rates  respectively.  This  is 
approximately  the  guadrupling  affect  which  was  predicted. 
Similarily,  when  the  message  lengths  tripled  from  5  to  15 
pkts/msg,  E[n]  increased  8.86  and  10.6  times  as  compared  to 
the  estimated  increase  of  9.  Finally  for  the  increase  in 
message  length  of  1.5  times,  the  resulting  E(n]  increase  was 
2.25  and  2.39  times  which  corresponded  to  a  calculated 
increase  cf  2.25.  These  results  indicate  that  the  behavior 
cf  the  network  of  queues  is  reasonable  when  geometrically 
distributed  messages  are  used  and  that  the  algorithm 
performance  does  not  appear  to  degrade. 

3.  Unbalanced  Traffic  Patterns 

All  simulation  results  discussed  thus  far  were 
obtained  using  a  uniform  distribution  of  traffic  throughout 
the  network.  The  uriform  distribution  was  accomplished  by 
picking  source-destination  node  pairs  at  random  for  each 
message  such  that  all  node  pairs  within  the  network  had  an 
equal  probability  of  selection.  As  a  result  the  number  of 
messages  generated  between  all  node  pairs  for  each  simula¬ 
tion  run  was  about  the  same. 
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An  unbalanced  traffic  pattern  exists  where  the  rate 
of  message  generation  between  node  pairs  differs  throughout 
the  network.  Static  routing  methods,  which  have  been 
designed  for  uniform  distributions,  are  severely  limited 
under  unbalanced  conditions.  The  ability  of  a  dynamic 
routing  algorithm  to  adjust  to  non-uniform  conditions  is  of 
prime  importance  in  evaluating  its  performance. 

For  this  test  the  same  thirteen  node  network  was 
used  with  seme  modifications.  All  traffic  generated  for  the 
network  was  dedicated  to  only  three  source-destination  node 
pairs.  The  pairs  selected  were  nodes  1  and  13,  nodes  9  and 
5  and  nodes  12  and  2  with  the  first  node  being  designated 
the  source  and  the  second  the  destination.  These  particular 
node  pairs  were  selected  based  upon  their  locations  in  the 
network.  They  are  all  located  on  the  perimeter  with  source 
and  destination  nodes  being  on  opposite  sides  of  the 
network.  The  purpose  was  to  allow  a  wide  number  of  criss¬ 
crossing  paths  to  exist  for  the  traffic  in  an  attempt  to 
vigorously  test  the  algorithm's  capabilities. 

As  a  reference  point,  the  unbalanced  network  was 
initially  tested  using  static  least  hop  routing.  Frier  to 
running  the  simulation  one  could  compute  the  maximum  traffic 
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intensity  which  the  network  cculd  handle  before  saturating. 
The  capacity  of  each  link  is  20  packets  per  second.  With 
three  source-destination  pairs,  the  maximum  packet  genera¬ 
tion  rate  (if  seperate  link  paths  existed  for  the  three 
routes)  would  by  60  packets  per  second.  However,  the  static 
routing  table  (Table  V)  indicated  that  link  (9,2)  was  used 
in  the  best  path  for  two  of  the  node  pairs.  Therefore  for 
the  static  run  this  link  should  saturate  when  the  packet 
generation  rate  is  only  30  packets  per  second  or  10  packets 
per  second  for  each  node  pair. 

Figure  5.28  provides  a  three  dimensional  view  of  the 
network  with  the  height  of  the  arrows  between  nodes  indi¬ 
cating  the  utilization  of  the  link.  It  is  evident  that  with 
static  routing  the  lack  of  alternate  paths  was  extremely 
detrimental  to  the  performance  of  the  network.  when  using 
dynamic  routing,  the  traffic  should  be  more  broadly  distrib¬ 
uted  ever  the  network  and  thus  the  traffic  load  between  node 
pairs  could  be  increased  before  saturation  occurred. 

Figures  5.29  and  5.30  show  the  distribution  of 
traffic  using  the  Yen  algorithm  at  packet  generation  rates 
of  50  and  100  packets  per  second.  The  highest  link  utiliza¬ 
tion  for  the  network  at  50  packets  per  second  was  only  0.W3 


NETWORK  PARAMETERS 


Source-Destination  Node  Pairs . 

Node  1  to  13,  9  to  5  and  12  to  2. 
Packet  transmission  time  ■  0.0500  secs 


Pkt  generation  rate  ■■  30  pkts/sec 
Avg  pkts  per  message  "  1.0 
Static  Routing  used. 


Figure  5 


Unbalanced  Traffic:  Static 
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NETWORK  PARAMETERS: 

Source-Destination  Node  Pairs . 

Node  1  to  13,  9  to  5  and  12  to  2. 

Packet  transmission  time  =  0.0500  secs 
Update  transmission  time  "  0.00125  secs 
Node  update  interval  m  0.5000  secs 
Pkt  generation  rate  "  50  pkts/sec 
Avg  pkts  per  message  m  1.0 
Dynamic  Routing  with  Method  5  used. 

Window  time  "  0.375  secs 

No.  of  windows  "  10 

j 


Figure  5.29  Unbalanced  Traffic:  Dynamic  -  50  pkts/sec 
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NETWORK  PARAMETERS:. 

Source-Destination  Node  Pairs . 

Node  1  to  13,  9  to  5  and  12  to  2. 

Packet  transmission  time  **  0.0600  secs 
Update  transmission  time  *  0.00125  secs 
Node  update  interval  “  0.5000  secs 
Pkt  generation  rate  “  100  pkts/sec 

Avg  pkts  per  message  *■  1.0 
Dynamic  Routing  with  Method  5  used. 
Window  time  ■  0.375  secs 

No.  of  windows  “  10 


Figure  5.30  Unbalanced  Traffic:  Dynamic  -  100  pkts/sec 
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and  still  cnly  0.6  9  at  100  packets  per  second.  From  both 
figures  it  is  clear  that  traffic  between  node  pairs  has  been 
distributed  throughout  the  network  and  thus  the  dramatic 
increase  in  performance  was  achieved. 

4.  Datagram  afid  Virtua  1  Circuits 

Chapter  I  mentioned  that  the  performance  of  any 
dynamic  routing  method  will  be  reduced  when  virtual  circuits 
are  used.  Virtual  circuits  "lock”  the  path  taken  by  all 
packets  of  a  message  to  that  selected  by  the  first  one.  If 
network  conditions  change  after  the  initial  "trail-blazer" 
packet  establishes  the  route,  subseguent  packets  may  no 
longer  be  taking  the  best  bath. 

In  testing  the  degradation  in  network  performance 
using  virtual  circuits,  geometrically  distributed  message 
lengths  were  used.  Figure  5.31  shows  the  outcome  of  the 
simulations  with  the  results  being  very  similar  to  those 
received  when  datagrams  were  used  (Figure  5.27)  .  However 
there  was  some  degradation  in  performance,  the  percentage 
difference  between  the  two  methods  being  given  in  Figure 
5.32.  These  results  are  highly  dependent  upon  network 
topology  and  are  presented  only  to  give  a  feeling  for  the 
type  of  degradation  in  performance  which  is  likely  to  occur. 


Avg  No.  of  Pkts  in  Transit 


V  V  V 


VARYING  THE  AVERAGE  NUMBER  OF 
PACKETS  PER  MESSAGE  USING  A 
GEOMETRIC  DISTRIBUTION 


NETWORK  PARAMETERS 

Packet  transmission  time  =  0.0500  secs 
Update  transmission  time  “  0.00125  secs 
Node  update  interval  ■  0.5000  secs 
Dynamic  Routing  with  Method  5  used. 
Window  time  «■  0.376  secs 

No.  of  windows  "  10 

VIRTUAL  CIRCUITS  WERE  USED. 


Figure  5.31  firtual  Circuit  Results 
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PERCENTAGE  INCREASE  IN  AVERAGE 
NUMBER  OF  PACKETS  IN  TRANSIT 
WHEN  USING  VIRTUAL  CIRCUITS 


Pkt  Generation  Rate  (pkts  per  sec) 


NETWORK  PARAMETERS 

Packet  transmission  time  “  0.0500  secs 
Update  transmission  time  —  0.00125  secs 
Node  update  interval  *■  0.5000  secs 
Dynamic  Routing  with  Method  5  used. 
Window  time  “  0.375  secs 

No.  of  windows  “  10 


Figure  5.32  Virtual  Circuits  vs.  Datagraas 
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As  expected,  the  longer  the  average  message  size  the  poorer 
virtual  circuits  faired  with  '  datagrams. 

6.  PEBFCBBiSCE  COHP1BISON  WITB  1  BOOTING  FRACTION  SCHEME 

While  the  research  was  underway  for  this  project,  a 
second  project  began  which  investigated  the  performance  of  a 
routing  fraction  protocol  £Bef.  24].  In  order  to  provide  a 
basis  for  comparison,  the  simulation  program  presented 
herein  was  utilized  as  the  "driver"  for  the  second  project. 
Eecause  of  the  design  of' the  program,  the  only  major  altera¬ 
tions  required  to  accomodate  the  routing  fraction  protocol 
centered  in  the  Update  Routing  Protocol  events  and  routines. 
The  ether  major  divisions  cf  the  program,  which  concerned 
message  traffic  transport,  data  collection  and  simulation 
preparation,  were  not  significantly  changed.  In  this  way  a 
comparison  study  of  different  routing  procedures  using  the 
same  "driver"  routines  could  be  analyzed. 

Upon  completion  cf  the  second  project,  both  routing 
protocols  were  tested.  Tc  ensure  that  the  programs  still 
only  differed  by  the  routing  protocols,  both  were  first  run 
using  the  same  network  parameters  and  with  fixed  best  paths 
from  the  same  least  hop  routing  table.  The  statistical 
results  frem  both  pregram  runs  were  identical. 
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Next  the  programs  were  ran  such  that  the  performance  of 
the  Yen  algorithm  could  be  compared  to  that  of  the  optimally 
selected  routing  fraction  method.  The  selection  of  the 
routing  fractions  was  possible  since  the  traffic  distribu¬ 
tion  for  the  network  was  knew  to  be  uniform.  Therefore  the 
resulting  multiple  path  routing  strategy  was  "matched”  to 
the  network  conditions. 

The  intensity  of  the  incoming  traffic  was  set  at  335 
pkts/sec  which  corresponded  to  the  saturation  point  of  the 
network  when  least  hep  routing  had  been  used.  The  Yen  simu¬ 
lation  was  run  using  the  same  parameters  as  in  the  last 
section  with  the  exception  that,  the  update  interval  was  set 
to  0.20  seconds.  The  results  of  the  comparison  are  given  in 
Table  IX.  From  these  results  it  is  evident  that  the  Yen 
algorithm  is  able  tc  perform  almost  as  well  as  a  static 

multiple  path  method  which  is  operating  on  its  "home  turf". 
This  term  is  used  since  within  this  static  environment  the 
routing  fraction  method  can  yield  the  optimal  results.  Thus 
the  optimal  routing  fraction  technique  provides  a  perform¬ 
ance  yardstick  with  which  tc  measure  how  well  the  Yen  algo¬ 
rithm  actually  works.  Again,  from  these  initial  findings, 

the  ability  of  the  Yen  algorithm  to  approach  optimal 

performance  appears  tc  be  very  good. 
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TABLE  IX 

Performance  Comparison  of  the  Algorithms 


Yen 

Aloorithm 

Routing 

Fraction 

Least 

Hoes 

Avg  Pkts  in 
Hetwork 
(in  pkts) 

59.6 

50.3 

102.3 

Avg  Pkt-Trip 

Time 

(in  secs) 

0.173 

0.148 

0. 301 

Avg  Cueue 

Size 

0.44 

0.30 

1.20 

(in  pkts) 


Additional  simulation  runs  were  done  using  the  unbal¬ 
anced  traffic  patterns  used  previously.  However,  the 
inability  of  the  static  routing  fraction  method  to  adjust 
caused  severe  performance  degradation.  We  have  already  seen 
that  the  dynamic  nature  of  the  Yen  algorithm,  on  the  ether 
hand,  allows  it  to  perform  in  an  unbalanced  environment  with 
acceptable  results. 

B.  TESTI8G  THE  HIEBJBCHICAI  YEBSIOH 

In  order  to  evaluate  the  peformance  of  the  hierarchical 
version  of  the  basic  algorithm  which  was  developed  earlier, 
some  modifications  were  made  to  the  network  parameters. 
These  changes  were  required  in  order  to  display  the 
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Figure  5.33  Test  Network  for  Hierarchical  Version 

operating  characteristics  of  the  new  algorithm.  First  a 
larger  test  network  was  used  which  had  24  nodes  and  52  full 
duplex  links  (Pigure  5.33).  The  hierarchical  structuring  of 
this  network  was  such  that  two  families  were  created  (each 
with  a  total  of  12  nodes)  and  each  family  was  divided  into 
two  groups  (each  with  6  nodes)  .  Though  this  network  is 
relatively  small,  it  was  found  that  running  larger  networks 


using  the-IB9  3033  was  very  expensive  in  terms  of  both  CPO 
time  and  memory  allocation. •  This  network,  though,  with  one 
additional  parameter  change  proved  to  be  adequate  for  the 
demonstration. 

One  cf  the  primary  reasons  for  using  a  hierarchical 
scheme  is  tc  reduce  the  overhead  from  update  transmissions. 
It  has  teen  shown  that  the  link  utilization  from  updates  is 
directly  related  to  the  number  of  nodes  in  the  network  when 
using  the  ncdal  algorithm.  However,  in  order  to  “load  down" 
the  network  from  update  packets  which  have  a  relatively 
short  (1/40th  of  a  message  packet)  transmission  time,  the 
size  cf  the  network  required  was  too  large.  In  order  to 
increase  the  "cost*'  cf  update  transmissions  for  the  purpose 
cf  comparison,  the  length  of  the  update  packet  was  therefore 
increased  ty  a  factcr  of  six.  This  is  the  same  technique 
used  in  the  previous  section  when  the  the  interval  between 
node  updates  was  varied.  It  was  now  possible  to  run  the 
simulation  using  both  the  nodal  ■  and  group/family  version  of 
the  Ten  algorithm  and  evaluate  their  performances. 

Two  methods  for  generating  the  unit  warning  message  were 
developed  for  the  program.  The  first  method  was  the  single 
'•leader'1  technique  where  one  node  per  unit  has  the 
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responsibility  of  generating  the  unit  warning  messages. 
Initially  the  scheme  where  each  node  in  a  unit  generated  its 
own  warning  messages  was  also  simulated.  However,  this 
method  was  discarded  when  the  poor  distribution  of  update 
mossages  in  time  caused  degraded  performance.  The  second 
technique  which  was  simulated  was  the  synchronized  firing  of 
unit  update  messages  whereupon  the  warning  message  contained 
a  resynchronization  time  instead  of  the  firing  time. 

The  results  from  simulation  runs  using  the  nodal  and  the 
two  warning  message  hierarchical  schemes  are  summarized  in 
Table  X.  The  table  lists  the  nodal  version  of  the  algorithm 
under  "NODE" ,  the  hierarchical  version  using  firing  time 
warning  messages  under  "NS"  (for  non-synchronized)  and  the 
version  using  warning  messages  containing  the  resynchroniza¬ 
tion  time  under  "S"  (for  synchronized).  All  hierarchical 
versions  were  run  using  a  node  update  interval  cf  0.25 
seconds  while  a  variety  cf  group  aijd  family  times  were 
chosen.  Two  nodal  runs  were  made  using  update  intervals  of 
0.25  and  0.50  seconds. 
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In  analyzing  the  results  some  overall  characteristics 


are  ncted: 

1.  The  link  utilization  due  to  update  transmissions  was 
substantially  reduce d  when  the  hierarchical  methods 
were  used.  In  the  case  where  node  update  intervals 
were  the  same,  the  hierarchical  methods  showed  a 
reduction  in  update  link  utilization  by  a  factor  of 
three  (0.125  as  compared  with  0.375  for  the  nodal 
scheme)  . 

2.  The  average  length  of  a  trip  which  a  packet  took 
using  the  hierarchical  schemes  was  longer  than  with 
the  nodal  version.  This  is  consistent  with  the 
nature  of  all  hierarchical  methods  in  which  reduced 
update  overhead  is  achieved  at  the  expense  of 
slightly  longer  packet  trips. 

3.  The  synchronized  version  of  the  hierarchical  methods 
performed  better  than  the  firing  time  warning  message 
version.  The  improvement  appears  to  be  from  the 
reduction  in  overhead  which  was  approximately  twenty 
percent  in  this  case. 

The  best  performance  using  the  hierarchical  methods  was 
not  obtained  when  the  update  intervals  were  shortest  but 


rather  when  the  groups  and  the  families  were  not  generating 
their  urit  updates  at  the  same  rate  as  the  nodes.  This 
occurred  using  the  synchronized  method  with  the  group  and 
family  intervals  at  0.5  and  1.0  seconds  respectively.  This 
performance  was  dramatically  better  than  the  node  version 
which  was  clearly  being  congested  with  overhead  traffic. 
Even  though  the  nodal  version  packet  trips  were  about  0.75 
hops  shorter  than  the  hierarchical  versions,  the  burdening 
effect  of  high  link  utilization  from  update  traffic  was  the 
dominant  factor.  Hcwever,  when  the  nodal  version  was  run 
using  a  larger  update  interval  such  that  the  overhead  link 
utilization  was  halved,  its  performance  improved. 

The  benefits  from  the  use  of  hierarchical  methods  in 
large  networks  have  teen  demonstrated  in  this  section.  It 
should  be  noted  that  incorporating  such  schemes  in  very 
large  networks  is  not  merely  convenient  but  an  absolute 
requirement.  Recall  that  the  formula  for  the  link  utiliza¬ 
tion  due  to  update  transmissions  could  be  calculated 
directly.  Since  the  size  of  the  update  packet  is  small  tut 
relatively  fixed  in  length  and  the  update  interval  must 
remain  reasonably  sbcrt,  there  is  a  finite  network  size 
before  the  links  will  saturate  due  to  update  transmissions 
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alone.  Therefore  the  implementation  of  the  hierarchical 
version  becomes  mandatory  in  a  large  network. 


I.  LARGE  1ETBORK  SIMULATION 

The  choice  of  relatively  small  networks  (25  nodes  or 
less)  for  the  majority  of  simulation  work  was  based  prima¬ 
rily  upon  limitations  which  the  IBM  3033  had  upon  job  execu¬ 
tion  time  and  available  memory.  Simulating  the  routing 
protocol  involved  larce  amounts  of  both  these  items.  The 
maximum  time  limit  for  a  single  job  was  one  hour  which 
corresponded  to  a  thirty  second  simulation  of  a  25  ncde 
network. 

However,  during  the  last  guarter  of  work  cn  this 
project,  SIMSCRIPT  II. 5  (Release  4.2)  was  made  available 
with  the  VAX  11/780  machine.  The  VAX  11/780  is  a  virtual 
address  computer  with  a  large  available  memory  (4  gigabytes) 
and  nc  limitation  on  program  execution  time.  The  similari¬ 
ties  between  the  VAX  and  IBM  versions  of  SIMSCRIPT  were  such 
that  transporting  the  simulation  between  machines  was  not 
difficult.  Program  modifications  were  centered  only  in  the 
I/O  processes. 

The  initial  design  of  the  "large"  network  consisted  of 
288  ncdes.  Hierarchical  structuring  produced  3  families  (96 


nodes  each),  with  fi  groups  per  family  (12  nodes  each). 
Initial  simulation  runs,  however,  exceeded  the  available 
memory  of  even  this  xachine  and  so  the  network  was  reduced 
to  a  single  family.  The  final  network  had  96  nodes  and  202 
full  duplex  links  (Figure  5.34). 

Testing  of  the  dynamic  hierarchical  routing  protocol  in 
this  network  was  made  using  a  highly  unbalanced  traffic 
distribution.  The  majority  (95  percent)  of  traffic  gener¬ 
ated  for  the  network  originated  from  Group  1  nodes.  In  a 
similar  manner,  the  same  percentage  of  generated  traffic  was 
destined  for  Group  4  nodes.  From  the  network  topology,  it 
can  be  seen  that  this  traffic  distribution  means  that  most 
traffic  must  travel  from  cne  side  of  the  network  to  the 
other.  Numerous  routes  can  be  visualized  to  include  flows 
cf  traffic  through  tfce  upper  two  groups,  the  center  group, 
and  the  bottom  three  groups  . 

In  order  to  get  a  performance  comparison,  the  simulation 
was  first  run  statically  using  the  least  hop  routing  scheme. 
The  packet  generation  rate  for  the  network  was  100  packets 
per  second.  This  traffic  intensity  was  selected  such  that 
link  saturation  was  beginniig  to  occur.  The  results  of  the 
simulation  run  are  presented  in  a  pictoral  rather  than 
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tablular  form  so  that  the  overall  link  usage  of  the  network 
can  fce  clearly  seen.  Figure  5.35  presents  four  views  of  the 
network  with  each  view  depicting  those  links  which  had 
utilizations  within  the  range  specified.  As  expected  with 


the  static  scheme,  the  majority  of  the  links  received  very 
little  usage  while  the  links  belonging  to  the  best  path  were 
saturated.  At  the  conclusion  cf  the  ten  second  simulation 
only  727  of  the  1030  packets  generated  had  completed  their 
trips. 

The  simulation  was  then  run  using  the  hierarchical 
distributed  algorithm  with  synchronized  unit  update  trans¬ 
missions.  Update  packet  size  was  kept  at  the  size  used 
previously  (1/40th  of  a  message  packet)  and  both  the  node 
and  group  update  interval  was  set  to  0.5  seconds.  The 
results  are  given  in  Figure  5.36.  Network  views  corre¬ 
sponding  tc  link  utilizations  greater  that  0.6  were  not 
required  since  the  highest  utilization  of  any  link  in  the 
network  was  0.586.  The  view  .showing  the  utilization  range 
from  0.3  to  0.6  clearly  shows  the  ablility  of  the  algorithm 
to  effectively  route  traffic.  At  the  conclusion  of  the 
simulation  the  network  was  stable  with  917  of  the  1030 
generated  packets  having  completed  their  trip.  The  average 
link  utilization  due  to  update  traffic  was  only  0.026  and 
therefore  did  not  interfere  with  message  traffic.  Had  the 
nodal  version  been  used,  the  average  link  utilization  from 
update  traffic  alone  would  been  approximately  1  which  again 
points  cut  the  requirement  for  the  hierarchical  version. 


Link  Utilization  Range 
0.0  to  0 .3 


•  •  • 
•  •  •  • 
•  •  • 


Link  Utilization  Range 
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A.  CCICIOSICIS 

The  path  which  lead  to  the  development  of  the  combina¬ 
tion  link  weight  function  and  the  hierarchical  distributed 
routing  procedure  was  by  no  means  a  "least  hop"  one.  Many 
detours  were  taken  while  enroute  which  were  time  consuming, 
tut  not  without  benefit  in  terms  of  derived  insight.  In 
summarizing  the  many  points  of  conclusion  obtained  during 
the  course  of  this  project,  a  chronological  approach  is 
used.  In  addition  to  the  actual  results  obtained,  seme 
lessons  learned  by  this  author  are  also  included. 

Initially  the  simulation  program  model  was  developed  on 
a  much  simpler  scale  than  that  which  appears  herein. 
Modularity  and  understandability  were  emphasised  so  that  as 
the  model  grew  in  realism  (and  became  more  complex),  it  did 
not  become  unmanageable.  In  doing  so,  the  impact  that  modi¬ 
fications  to  the  model  had  upon  the  simulation  operation 
were  not  lost.  This  process  is  best  seen  by  example. 

An  early  version  of  the  simulation  model  did  not  use 
update  queues  under  the  assumption  that  the  effects  of 
update  collisions  would  be  negligible  upon  the  performance 
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of  the  routing  algorithm.  As  the  model  grew,  the  update 
insertion  technique  was  included  with  its  resulting  update 
packet  gueueing  delays.  The  new  simulation  results 
confirmed  an  earlier  speculation  that  queued  updates  did  not 
dramatically  change  the  best  path  calculations.  However, 
only  by  working  from  the  simple  to  the  more  complex  model 
could  these  conclusions  have  been  made. 

Another  goal  during  the  model  development  stage  was  in 
finding  techniques  which  could  be  used  to  validate  the  simu¬ 
lation.  The  use  of  analytical  methods  proved  very  effective 
in  this  area.  The  key  was  in  matching  the  network  parame¬ 
ters  to  situations  which  could  be  duplicated  using  the  math¬ 
ematical  techniques.  In  doing  so  the  results  obtained 
during  simulation  closely  agreed  with  those  using  the 
analytical  methods.  The  simulation  operation  was  also  veri¬ 
fied  using  a  painstaking  process  whereby  every  network 
process  involving  individual  packets  was  printed  out. 
Therefore,  prior  tc  the  simulation  being  run  using  the 
routing  protocols,  the  model  had  been  convincingly  tested. 

After  establishing  a  workable  simulation  model,  it  scon 


became  apparent  that  a  dynamic  routing  protocol  is  only  as 
good  as  the  information  upon  which  it  makes  the  estimate  of 


the  network  conditions.  The  combination  link  weight 
function  which  was  finally  developed  appears  to  provide  an 
accurate  and  responsive  measurement  upon  which  the  routing 
decision  can  be  made.  A  somewhat  unexpected  characteristic 
cf  the  combination  method  was  the  relative  insensitivity  of 
its  parameters  upon  the  algorithm’s  performance.  The  Queue 
Factor  term  demonstrated  very  acceptable  performance  over  a 
wide  range  of  network  parameters.  In  fact,  the  modified  Yen 
algorithm  seemed  to  be  hard  to  ’’break  down"  even  when 
subjected  to  a  variety  of  chaotic  and  unbalanced  traffic 
conditions.  The  robustness  of  the  modified  version  was 
further  shewn  when  dcring  conditions  of  rather  gross  timing 
limitations,  the  network  performance  remained  basically 
unchanged. 

It  should  be  emphasised,  though,  that  it  was  not  the 
intent  cf  this  research  to  find  the  "optimal"  set  of  parame¬ 
ters  for  the  routing  protocol.  The  effects  that  one  param¬ 
eter  had  upon  another  were  interrelated  and  thus  the  problem 
would  have  become  one  of  finding  a  global  optimum  in 
N-dimensicnal  space.  The  vastness  of  this  space  precluded 
such  a  search  and  sc  a  working  set  of  parameters  was  found 
instead. 
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During  the  development  of  the  nodal  version  of  the  Yen 
algorithm,  a  simple  formula  was  derived  which  solved  for  the 
overhead  link  utilization  due  to  update  transmissions  from 
known  network  parameters.  It  was  this  result  which  helped 
to  provide  the  motivation  for  the  development  of  a  hierarch¬ 
ical  version.  The  nodal  version,  though  extremely  capable, 
was  limited  to  networks  of  a  particular  size  due  to  the 
detrimental  effects  which  the  overhead  traffic  produced. 
The  maximum  network  size  was  a  function  of  a  number  of 
parameters.  For  the  parameter  values  used  in  this  work,  the 
limiting  network  size  was  approximately  100  nodes. 

The  hierarchical  scheme  which  utilized  synchronization 
warning  messages  produced  the  least  overhead  and  the  best 
performance  of  those  tested.  The  feasibility  of  this  method 
was  demonstrated  using  the  large  network  of  100  nodes.  The 
real  "savings"  from  this  method  over  the  non-synchrcnized 
hierarchical  scheme  came  from  the  substantial  reduction  in 
unit  warning  messages  which  were  passed  using  the  flooding 
technique. 

The  ability  of  the  algorithm  to  function  with  little 
performance  degradation  in  an  environment  of  hardware  deck 
limitations  and  delays  due  to  queued  updates  was  another 
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positive  result.  It  appears  that  in  general,  these  random 
timing  inaccuracies  were  negligable  compared  to  the  magni¬ 
tude  of  the  link  weight  function  calculations.  The  hybrid 
characteristics  of  the  combination  function  also  assisted  in 
damping  small  weight  variations  which  may  be  caused  by  these 
delays. 

The  limited  work  which  was  performed  using  the  VAX 
11/780  with  the  nearly  100  node  network  came  late  in  the 
project.  However,  the  results  from  these  tests  were  central 
to  this  eork.  By  demonstrating  the  workability  of  the 
protocol  cn  a  complex,  non-symmetric  network,  seme  of  the 
doubts  which  haunt  siall,  symmetric  simulations  are  removed. 
Curing  the  development  stages,  small  network  simulations 
were  required  in  order  that  the  mechanics  of  the  algorithm 
could  fce  verified.  Crce  the  hierarchical  version  was  devel¬ 
oped,  though,  the  requirement  to  test  it  on  a  large  network 
became  the  central  issue  in  establishing  its  credibility. 
In  successfully  doing  so,  a  major  goal  of  the  project  was 
met. 

E.  . BECCBBEHDATIGHS  FCB  FURTHER  STUOT 

During  the  development  of  this  project,  several  courses 
of  action  which  future  work  might  take  became  apparent. 
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Some  of  these  areas  require  only  further  simulation  with  the 
program  in  Appendix  C,  while  others  require  the  production 
of  additional  programs.  The  area  mentioned  first,  since  it 
was  partially  begun  during  the  final  phase  of  this  project, 
is  that  of  large  network  simulations.  Studies  could  lock  at 
the  selection  of  node,  •  group  and  family  update  intervals  in 
order  to  achieve  improved  performance.  Initial  results  tend 
to  show  that  larger  units  did  net  have  to  update  as  often  as 
smaller  ones,  but  this  was  not  conclusive. 

The  simulation  program  already  includes  a  routine 
designed  to  allows  nodes  near  unit  borders  to  maintain 
routing  information  on  neighboring  nodes  belonging  to  ether 
units.  This  information  would  enable  packets  destined  for 
these  neighboring  nodes-  to  take  the  best  path  to  the  node 
itself  vice  the  best  path  to  the  group  or  family  of  the 
node.  Using  the  large  network,  it  would  be  possible  to  run 
comparison  simulations  while  varying-  the  "depth"  within  the 
unit  borders  for  which  node  routing  table  entries  would  be 
maintained. 

The  topology  remained  fixed  throughout  all  simulations 
run  during  this  project.  The  program,  though,  is  capable  of 
modeling  a  dynamically  changing  network  topology.  Link 


connectivity  can  be  altered  simply  by  removing  or  adding 
links  to  the  node's  link  set.  The  addition  or  deletion  of 
nodes  would  require  a  bit  more  planning  since  nodes,  as 
permanent  entities,  are  created  at  the  same  time.  However, 
the  destruction  or  joining  of  nodes  to  the  network  could 
still  be  handled  by  the  deactivation  or  activation  of  links. 
Using  this  technique,  a  wide  variety  of  scenarios  can 
develop  ranging  from  static  network  topologies  that  experi¬ 
ence  random  node  and  link  failures  to  completely  mobile  ones 
used  to  represent  a  packet  radio  network. 

The  "Successor"  algorithm  of  Appendix  B  could  be  simu¬ 
lated  in  this  dynamic  environment.  This  algorithm  could  be 
used  in  ccnjunction  with  work  concerned  with  the  "start-up" 
phase  of  a  packet  network.  The  whole  area  of  network 
activation  is  .  very  important  to  the  feasibility  cf  a 
distributed  network  and  cannot  be  overlooked  in  the  design 
considerations . 

This  work  has  fccused  cn  the  application  of  a  distrib¬ 
uted  routing  protocol  within  a  packet-switched  communica¬ 
tions  network.  It  may  be  of  interest  to  study  the 

applicability  of  this  protocol  in  a  packet-radio  network. 
Packet  radic  networks  exhibit  some  unique  qualities  which 


night  make  the  use  cf  a  tine-dependent  routing  protocol 
particularly  difficult. 

During  this  work,  perfornance  conparisons  were  done  with 
a  routing  fraction  protocol.  The  Yen  algorithm  produces  a 
single  best  path  node  for  each  destination  and  not  a  set  of 
■routing  fractions.  Future  work  may  look  at  developing  a  set 
cf  alternative  paths  from  the  Yen  algorithm  by  keeping  track 
cf  the  tentative  update  transmission  times.  Relationships 
nay  be  developed,  fcr  example,  between  the  ''second  test" 
update  transmission  time  and  the  selection  of  alternate 
paths. 

In  conclusion,  this  thesis  was  a  preliminary  investiga¬ 
tion  intc  the  application  of  the  Yen  routing  algorithm 
within  a  packet- switched  communications  network.  The 
initial  development  from  this  study  was  a  modified  version 
of  the  algorithm  which  exhibited  hybrid  operating  character¬ 
istics  when  used  in  conjunction  with  the  proposed  combina¬ 
tion  link  weight  function.  The  final  algorithm  development 
was  a  hierarchical  version  utilizing  synchronized  unit 
update  transmissions  which  allowed  the  protocol  to  operate 


in  large  networks 


l££ISm  k 

THE  IBB  SHORTEST  PATH  ALGORITHM 

In  an  N-ncde  directed  network,  let 

{I},  I  =  1  to  N,  be  the  nodes  of  the  network. 

<I,J)  be  the  link  connecting  node  I  to  node  J. 

H  (I,  J)  >  0  be  the  weight  of(I,J). 

F (I, K)  be  the  distance  of  the  tentative  shortest 
path  from  node  I  to  node  K. 

T[F(I,K)  ]  be  the  finite  length  of  time  defined 
to'  represent  the  corresponding  value  of  F(I,K). 

let  C  be  the  constant  such  that  C  =  F  (I,K)  /T[  F  (I  ,K)  ] 

Initially,  all  F(I,K)'s  and  T[F(I,K)  ]*s  are  set  to  co. 

STEE  1:  At  time  0,  the  destination  node  K 

sends  each  of  its  Neighbor  (out)  nodes  J 
a  simple  message  "K". 

STEE  2:  Cn  receiving  a  message  "K”,  each 

node  J  must: 

A.  Label  the  node  that  has  just  sent 
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the  aessage  node  L  and  delete  node  L 
from  its  Opdate  Transmission  List. 

E.  Bead  the  clock  and  let  T[  F  (Lf  K)  ] 

equal  the  time  it  reads  from  the  clock 
and  let  F(L,K)  =  C  *  T[F(L,K)]. 

F(L,K)  is  the  Opdate  Reception  Height. 

C.  Opdate  F(J,K)  by 

F(J,K)  =  min[F(J,K)  ,  H  (JrL)  ♦  F  (L,  K)  ]. 
F  (J ,  K)  is  the  Tentative  Shortest  Path 
Distance  and  W(J,L)  is  the  Reverse  Link 
Height. 


C.  Let  T[F(J,K)]  =  F(J,K)  /  C. 

T[F(J#K)  ]  is  the  Tentative  Time  of 
Opdate  Transmission. 


E.  At  time  T[F  <J,K)  ],  node  J 

sends  the  message  "J'*  to  Neighbors 
on  its  Opdate  Transmission  List. 


STEP  3:  Repeat  STEP  2  until  time  t*,  where  t*  is  a 

predetermined  constant  larger  that  any  possible 
T(P<J,K)  ]. 
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At  the  termination  of  the  algorithm,  each  node  J  has  the 
following  solution  to  the  shortest  path  to  destination  node 
X: 
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The  distance.  c£  the  optiaal  shortest  path  from  node  J 
to  the  destination  node  K ,  which  is  given  by  F(J,K), 


The  identity  cf  the  next  node  on  the  shortest  path 
frcm  node  J  tc  node  K,  which  is  indicated  by  the  node 
which  generated  the  final  F(J,K). 
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APPENDIX  B 

TEE  "SOCCESSOH"  MODE  SELECTION  AL60BITHB 

The  purpose  of  this  algorithm  is  to  provide  a  means  for 
the  hierarchical  version  of  the  Yen  algorithm  to  continue  to 
operate  in  the  event  that  the  current  Leader  node  within  a 
tasic  unit  (i.e.  group  or  family)  fails.  The  Leader  node  is 
responsible  for  generating  the  unit  warning  message  which  is 
then  sent  to  all  members.  This  warning  message  contains  the 
identity  of  the  Leader  node  and  the  time  at  which  all  nodes 
are  to  send  the  unit  update  message.  If  the  Leader  node 
fails,  then  the  unit  will  nc  longer  be  able  to  provide 
update  information  fcr  the  rest  of- the  network.  This  same 
algorithm  is  also  applicable  to  network  "start-up"  periods 
when  the  units  themselves  are  forming  and  Leader  nodes  must 
be  selected.  The  following  definitions  are  given  which  will 
be  utilized  in  the  algorithm. 

In  an  N-node  directed  network,  let: 

I,  J,  L  be  nodes  belonging  to  a  basic  group 

cf  the  network.  A  group  was  chosen  for  this 
description  yet  this  is  applicable  to  any  level 
unit. 


236 


Each  cede  have  a  clocking  device  called  a  Timer 
which,  upon  setting,  will  time  out  at  t  =  T(max). 

T  (max)  be  greater  than  any  time  interval  between 
consecutive  group  warning  messages  being  received 
by  any  node  in  the  group. 

GWfl]  be  the  Group  Warning  message  originating 
frem  nede  I. 

T  (grp)  be  the  average  time  between  generation  of 
consecutive  group  warning  messages  by  the  leader 
node. 

S[  I,T  (I)  ]  be  the  Successor  message  containing  the 
identity  of  node  I  and  the  time  T(I)  when  the 
Successor  message  was  originated. 

The  algorithm  is  presented  in  terms  of  the  three 
different  events  which  can  occur  during  network  operation 
resulting  from  its  usage.  These  events  are 

1.  A  node  receives  a  group  warning  message. 

2.  A  nede  "times  cut".  This  means  that  the  node  has  not 
received  a  group  warning  message  within  T  (max) 
seconds.  Each  node  has  a  re-settable  timer  which  it 
uses  to  detereine  this. 
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vs 


3.  A  node  receives  a  successor  message 


Successor 


messages  are  sent  by  nodes  which  have  “timed  cut"  and 
are  new  competing  for  the  function,  of  being  the  group 
Leader. 

The  algorithms  related  to  each  event  are  as  follows. 


EtENT  1 


At  time,  t,  node  I  receives  GR[L]  from  node  K  and  performs 
the  following: 

Node  I  carries  cut  standard  group  update  proce¬ 
dures.  This  involves  retransmitting  the  group 
warning  message  and  then  scheduling  its  own  group 
update  message  to  be  “fired"  at  the  specified 
firing  time  given  in  the  warning  message. 

Cancels  the  scheduled  transmission  of  GW(I]  if  it 
had  keen  scheduled. 


Sets  S[I,T(I)  ]  =  SCI,  oo  ]. 
Besets  its  Timer. 
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EVENT  2 


At  time  t*,  node  J»s  Ti'ner  "times  out".  Node  J  then 
performs  the  following: 

If  T  (J)  =  oo  , 

Let  SC  J,T  (J)  ]  =  S[ J,t*  ]; 

Transmit  S(J,T(J)  ]  to  all  neighbor  nodes  within 
same  group; 

Schedule  the  transmission  of  GW[J]  to  all  ne-ighfccr 
ncdes  within  same  group  at  time  t  =  t*  +  T  (max)  ; 

Beset  the  Timer. 

If  I  (J)  *  oo  > 

Transmit  S[J#T(J)  J  to  all  neighbor  nodes  within 
same  group; 

Beset  the  Timer. 


EVENT  3 

At  time  t**,  node  J  receives  S[I,T(I)  ]  from  node  K.  Ncde  J 
performs  the  following; 


then 
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*  node  j  2j. 

already 

then,  °''t”  »»«  trans„ltt8a 

If  T<r’  <  *H)  then, 

C"CW  the  scheduled  truns  ■ 

Let  sCJ,Tni  ^  J * 

M)  j  *  SfI,TfI)  J. 

T”“S,lt  s'^«,  to  uu  . 

the  sa.e  ,  n619ht°f  "odes 

9  "P  ei«Pt  node  K: 

R®set  the  rimer, 

•*«»  then. 


If  1  then, 

Cancel  th 
G»f  J  J; 


schedule 


ttansnission  of 


Iet  SCJ,T(J)  j  .  , 


BS"lt  SCJ'T,J)  J  t0  au  . 

»fthl„  the  nei?hbor  nodes 

Sese‘  the  tian. 


If  1  >  '  then, 

"C  4Ctio”  to  taften. 

If  T  (X)  >  rn  . 


H--sM SI 


.  - .  ,  . 

•  h  *-■«»»  "j 


No  action  is  taken 


If  node  J  has  net  "timed  cut"  then. 

If  T  (I)  <  I  (J)  then. 

Let  S[J,T(J)  ]  =  S[  I , T  ( I)  ]; 

If  T  (I)  =  1  (J)  then. 

If  I  <  J  then. 

Let  S[  3  ,T  (J)  ]  *  S[  I , T  (I)  ]. 

If  I  >  J  then. 

No  action  is  taken. 

If  T  (I)  >  T  (J)  then, 

Nc  action  is  taken. 

Figure  B.1  shows  the  network  which  is  used  to  illustrate 
how  this  algorithm  performs  in  the  event  that  the  leader 
node  fails.  The  current  leader  is  node  1  as  the  network 
activities  commence.  The  time  delay  associated  with  each 
link  is  0.1  seconds  with  the  average  time  between  consecu¬ 
tive  group  warning  messages  being  2  seconds.  T  (max)  is  4 
seconds  which  is  greater  than  the  normal  interval  of  time 
between  receptions  of  the  group  warning  message  by  any  node 
in  the  unit. 
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Figure  E.1  Network  for  Demonstrating  Successor  Algorithm 
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to  Nodes  2  and  3. 

0.) 

Ncde 

2: 

Be  vs 

GW  (1) 

from  Node  1. 

Sets 

Timer 

to  0.1  ♦  4  =  4.1. 

Xmts 

GW  (1) 

to  Nodes  3  and  4. 

Ncde 

3: 

Bcvs 

GW  (1) 

from  Node  1. 

Sets 

Timer 

to  0.1  ♦  4  =  4.1. 

Xmts 

GW  (1) 

to.  Nodes  2 ,  4,  5. 

CM 

• 

O 

Node 

4: 

Bcvs 

GW  (1) 

from  Nodes  2  and  4 

Sets 

Timer 

to  0.2  ♦  4  =  4.2. 

Xmts 

SW(1) 

to  Node  5. 

Node 

5: 

Bcvs 

GW  (1) 

from  Node  3. 

Sets 

Timer 

to  0.2  ♦  4  =  4.2. 

Xmts 

G  W  (1 ) 

to  Node  4. 

0.3 

Node 

4: 

Ignores  GW(1)  from  Ncde  5. 

Ncde 

5: 

Ignores  GW(1)  from  Ncde  4. 

Node  1:  "Fails"  as  Group  Leader. 

Node  2:  Timer  "Times  Out". 

Xmts  S  (2  ,  4.1)  to  Nodes  3,  4 
Schedules  GW  (2)  xmt  at 
4.1  ♦  2  *  6.1. 

Besets  Timer  for  4.1  +  4  =  8. 

Node  3:  Timer  "Times  Out". 

Xmts  S  (3  ,  4.1)  to  Nodes  2 ,  4 
Schedules  GW  (3)  at 
4.1  ♦  2  =6.1. 

Besets  Timer  for  4.  1  ♦  4  =  8. 

Ncde  2:  Bcvs  S  ( 3  ,  4.1)  from  Node  3. 

No  action  is  taken. 

Ncde  3:  Bcvs  S(2  ,  4.1)  from  Node  2. 

Cancels  GW  (3)  . 

Xmts  S  (2  ,  4.1)  to  Nodes  4r  5 
Sets  Timer  for  4.2  ♦  4  =  8.2. 

Ncde  4:  Timer  "Times  out". 

Bcvs  S  (2  ,  4.1)  and  S  (3  ,  4.1 
Xmts  S  (2  r  4.  1)  to  Node  5. 
Sets  Timer  for  4.2  ♦  4  =  8.2. 

Ncde  5:  Timer  "Times  Out". 

Bcvs  S  (3  ,  4.  1)  from  Node  3. 
Xmts  S  (3  ,  4.1)  to  Node  4. 
Sets  Timer  for  4.2  ♦  4  =  8.2. 

Ncde  4:  Bcvs  S  ( 3  ,  4.1)  from  Node  5. 

No  action  is  taken. 


Ncde  5:  Bcvs  S(2  ,  4.1)  from  Node  4. 

Identity  cf  Node  2  <  Ncde  3. 
Xmts  S  ( 2  ,  4.1)  to  Node  3. 


Sets  Timer  for  4.3  +  4  *  8.3. 


6.1 

Ncde 

2: 

Xmts  GW  (2)  to  Nodes  3  and  4. 

6.2 

Node 

3: 

Bcvs  GW  (2)  from  Node  2. 

Resets  Timer  for  6.2  ♦  4  =  10.2 

Xmts  GW  (2)  to  Nodes  4  and  5. 

Ncde 

4: 

Bcvs  GW  (2).  from  Node  2. 

Resets  Timer  for  6.2  ♦  4  =  10.2 

Xmts  GW  (2)  to  Nodes  3  and  5. 

6.3 

Ncde 

3: 

Ignores  GW  (3)  from  Node  4. 

Ncde 

4: 

Ignores  GW  (3)  from  Node  3. 

Node 

5: 

Revs  GW  (3)  from  Nodes  3  ar.d  4. 

Resets  Timer  for  6.3  ♦  4  =  10.3 
Open  conclusion  cf  this  example.  Node  2  had  become  the 

new  leader.  The  algorithm  operates  in  such  a  manner  that 

nodes  closest  to  the  Leader  will  compete  for  that  function 

if  the  leader  fails.  This  occurs  because  nodes  closest  to 

the  Leader  receive  the  warning  messages  first  and  thus  "time 

out"  first  in  the  event  that  a  warning  is  not  received. 
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APPENDIX  C 


SIMULATION  PROGRAM 

//  EXEC  3 1 M25CL  G , REG I  ON . GQ«4096K , P ARM . GO“ *M AP , S 1 ZE“7G0K  * 
//STSPRINT  00  STSOUT-A 
//S1M.SYSIN  DO  m 
PREAMBLE 


'kmmnkm  PACKET  SNITCHED  NETWORK  ****** 

******  simulation  program  ****** 

******  ******* 

******  UTILIZING  A  KM**** 

******  DYNAMIC  ROUTING  PROTOCOL  ****** 

******  BASED  ON  »»*»«» 

-NMMMMM  MKMMKM 

******  THE  TEN  SHORTEST  PATH  ALGORITHM  ****** 

.  BY  ROBERT  R.  LOGAN  ****** 

******  ****** 


NORMALLY  mooe  is  integer 
GENERATE  LIST  ROUTINES 
«  • 

•  • 

PERMANENT  ENTITIES . 

•  • 

EVERY  NOOE  HAS  A  GROUP,  A  FAMILY,  A  XMT. PERCENT,  A  RCV. PERCENT. 

A  OPT. RCV, 

OWNS  A  LINK. SET,  A  XMT.RECORO.  A  ALARM. CLOCK. 

A  VIRT.CKT .LIST 

OEFINE  XMT. PERCENT,  RCV. PERCENT  AS  REAL  VARIABLES 

V  • 

•  • 

TEMPORARY  ENTITIES . 

•  • 

EVERT  UPOATE  HAS  A  ORIGIN.  A  BEGIN. TIME,  A  FIRING. TIME, 

A  CLASS.  A  FM.NOOE,  A  TO. NOOE.  A  HOPCNT. 

A  VARIETY, 

MAY  BELONG  TO  A  UQUEUE,  A  UPROP. QUEUE 
OEFINE  BEGIN. TIME,  FIRING. TIME  AS  REAL  VARIABLES 

•  • 

EVERT  PACKET  HAS  A  ORG.NOOE.  A  BEG. TIME,  A  HOP. COUNT.  A  OEST.NOOE. 

A  RELAY. NOOE.  A  NEXT. NOOE.  A  MSG.10.NUM.  A  PKT.10, 
A  PKT.SUM,  A  LIFETIME.  A  OSTAT,  A  P.NAME, 

A  P. ARRIVAL. 

MAT  BELONG  "TO  A  QUEUE.  A  PROP. QUEUE 
DEFINE  BEG. TIME,  P. ARRIVAL  AS  REAL  VARIABLES 


EVERT  LINK  HRS  fl  STATUS.  A  TERN,  A  QTEST.  A  QUESIZ.  A  LK. HEIGHT. 
A  UPCOUNT,  A  PTCQUNT. 

OWNS  A  QUEUE.  A  PROP. QUEUE.  A  SET. OP. HEIGHTS. 

A  UQUEUE.  A  UPRQP. QUEUE. 

HAT  BELONG  TO  A  LINK. SET 
OEP1NE  LK. HEIGHT  AS  A  REAL  VARIABLE 

EVERT  HEIGHT  HAS  A  HT.SIZE, 

HAT  BELONG  TO  A  SET. OF. HEIGHTS 
DEFINE  HT.SIZE  AS  A  REAL  VARIABLE 

EVERT  CIRCUIT  HAS  A  CKT.IO.  A  VIRT.BP, 

HAT  BELONG  TO  A  VIRT.CKT.LIST 

EVERT  RECORD  HAS  A  REC. ORIGIN.  A  REC.TIHE. 

HAT  BELONG  TO  A  XHT. RECORD 
OEFINE  REC.TIHE  AS  A  REAL  VARIABLE 

EVERT  BUZZER  HAS  A  SETTING.  A  CAUSE.  A  TEMP. BP,  A  BUZ. BEG. 

A  BUZ. HAKE. 

OHNS  A  BUZ. LIST. 

HAT  BELONG  TO  A  ALARH. CLOCK 
OEFINE  SETTING.  BUZ.BEG  AS  REAL  VARIABLES 

EVERT  BUZ.NOOE  HAS  AN  I0.NUH8ER. 

HAT  BELONG  TO  A  BUZ. LIST 


EVENT  NOTICES  INCLUOE  U5. LINK. HEIGHT. CALCULATION.  El  .TRANS I ENT. BLANK INC. 
E2. COLLECT . OATA.  El . NETWORK . PERFORHANCE . REPORT 

«  « 

EVERT  Ul. GENERATE. UPOATE  HAS  A  SENDING. NODE.  A  UP. CLASS 
EVERT  UW. RECEIVE. UPOATE  HAS  A  UP.HESSAGE 

* » 

EVERT  U6.N00E.HAKE.UP  HAS  A  HK.NODE.  A  HK.HSG.  A  BPATH.  A  HOPNUH 

•  *■ 

EVERT  U7T UN IT. FIRING  HAS  A  PF.NOOE,  A  PF. CLASS.  A  PF. ORIGIN. 

A  PF. BEGIN 

OEFINE  PF. BEGIN  AS  A  REAL  VARIABLE 

#  •- 

EVERT  U8.  ERASE".  RECORO  HAS  A  ERA.  NODE,  A  ERA.  RECORO 

•  « 

EVERT  HI. GENERATE. MESSAGE  HAS  A  T. MESSAGE 

«  « 

EVERT  HZ.'RECEIVE.  MESSAGE.  PACKET  HAS  A  PA.CKET 

•  »• 

PRIORITT ‘OROER  IS  UH. RECEIVE. UPOATE,  M2. RECEIVE. MESSAGE .PACKET. 

Ml . GENERATE. MESSAGE.  UJ . GENERATE. UPOATE. 

U7. UNI T7FT  RING,  U6.N00E.HAKE.UP.  U8 . E RASE . RECORO , 


E2. COLLECT . DATA .  U5. L 1 NK . HE  I  GUT . CALCUL AT I  ON . 

El .TRANSIENT. BLANKING,  El. NETWORK. PERFORMANCE. REPORT 

«  • 

*'  DEFINE  QUEUE  AS  A  SET  RANKED  BT  HIGH  HOP. COUNT 

.ft  • 

DEFINE  NOD. TINE,  BRACKET.  U.XHN.TIHE.  PKT.XMN.TIHE, 

GP.FIRE,  GRP. TINE.  FM.FIRE,  FAN. TINE,  DELTA, 

NSG. GENERATION. INTERVAL.  TINE.LIHIT,  ERA. PERIOD. 

1NC.PPH,  ENO.PPH,  PPS.8EG,  PPS.INC,  PPS.END. 

PPS.AVE,  AVE.PPH.  NAX.PPH.  XHT. TOTAL.  QU. TOTAL. 

BEG.PPH.  RCV.PCNT.  TRNS.PCNT,  LNK. NOD. RATIO. 

MAX. LINKS. PER. NODE,  NAX. GRP. NODES.  XCOUNT.  NT. TINE. 

NAX. FAN. NODES.  IN. GROUP.  IN.FAHILT.  TRANSIENT. 

QU.FACT.  BIT. INTERVAL,  ND. STEPS.  NUL. TRANS  I ENT.  NO. FINISH 

AS  REAL  VARIABLES 


DEFINE  T RAF. LI  HIT.  UP. COUNT.  HOP. UNIT,  LINKS.  IPPH.  INSG, 

INIT.BP,  NUN. REPORTS. REQUESTED.  TEST.  SAHPLES,  NUNRUNS. 

NEW. NSG. TOTAL.  NEk. PKT. TOTAL.  COHP.TRIP. PKT,  STS. PACKETS. 
HOP.TOTAL.  NODE. FACTOR.  PANT.  FMLTS,  GRPS,  NGFS. 

NUN. OF. HEIGHTS.  NANNER . OF . ME I GHT I NG .  STEP. BT. HEIGHTS. 

USE. VIRT.CKTS,  OISCRETE.TIHER,  U. COUNT.  STATIC. BP. 

BT.GEOH.DIST,  GEONETRIC.  ST.EP.BT.NOD.TIHE.  STNCH. FIRING 

AS  INTEGER  VARIABLES 


ACCUNULATE  QUE. PKT. TINE  AS  THE  SUN  OF  QSTAT 
ACCUMULATE  TRANSIT. TINE  AS  THE  SUN  OF  LIFETIHE 
ACCUNULATE  LK.HEAN  AS  THE  HEAN  OF  STATUS 

ACCUNULATE  QU.HAX  AS  THE  HAXIHUH.  QU.NEAN  AS  THE  HEAN.  QU.OEV 
AS  THE  STD. DEV  OF  N. QUEUE 

ACCUMULATE  UP. MAX  AS  THE  NAXINUN.  UP. MEAN  AS  THE  MEAN.  UP. DEV 
AS  THE  STD. DEV  OF  N.UQUEUE 
ACCUMULATE  AVG. HEIGHT  AS  THE  MEAN  OF  QUESIZ 
ACCUNULATE  UP.RHO  AS  THE  MEAN  OF  N.UPROP. QUEUE 
ACCUMULATE  RHO  AS  THE  MEAN  OF  N. PROP. QUEUE 
ACCUMULATE  AV. STS. PACKETS  AS  THE  MEAN  OF  STS. PACKETS 


DEFINE' 

OUTQ 

TO  MEAN 

0 

OEFINE 

INQ 

TO  MEAN 

1 

DEFINE 

DEAD 

TO  MEAN 

0 

define: 

ALIVE 

TO  MEAN 

1 

DEFINE 

IDLE 

TO  MEAN 

0 

oefine 

BUST 

TO  MEAN 

1 

DEFINE 

REGULAR 

TO  MEAN 

1 

DEFINE 

HARNING 

TO  MEAN 

2 

OEFINE 

NOD. NSG 

TO  MEAN 

1 

OEFINE 

GRP. MSG 

TO  MEAN 

2 

OEFINE 

FAN. NSG 

TO  MEAN 

3 

OEFINE 

NONE 

TO  MEAN 

0 

7U7 


~  “  L. 


DEFINE 

BT.QSIZE.NOW 

TO 

MEAN  1  ' 

DEFINE 

8T.PAST.QSIZE 

TO 

MEAN  2 

DEFINE 

BT.PAST.QAVG 

TO 

MEAN  3 

DEFINE 

BT.RHO. WEIGHT 

TO 

MEAN  4 

DEFINE 

BT. COMBINE 

TO 

MEAN  S 

DEFINE 

BEST. PATH 

AS 

A  2-DIMENSIONAL 

ARRAT 

DEFINE 

OUP. BEST. PATH 

AS 

A  2-DIMENSIONAL 

ARRAT 

DEFINE 

FAM.OF.GRP 

AS 

A  1 -DIMENSIONAL 

ARRAT 

DEFINE 

BORN.PKTS 

AS 

A  2-DIMENSIONAL 

ARRAT 

DEFINE 

GONE.PKTS 

AS 

A  2-DIMENSIONAL 

ARRAT 

DEFINE 

JUMP. TOTAL 

AS 

A  2-DIMENSIONAL 

ARRAT 

DEFINE 
«  « 

END  ’  *OF 

*  *  MMMMI 

«  « 

MAIN 

LENGTH. TRIP 

PREAMBLE 

AS  A  2-DIMENSIONAL  1 

TEAL  Al 

c? 


ET  LINES. V  *  79 
« 

•  THE  MAIN  ROUTINE  ACTS  AS  THE  CONTROLLER  FOR  INITIALIZING 

’  AND  THE  SUBSEQUENT  EXECUTION  OF  MULTIPLE  SIMULATION  RUNS. 

•  THIS  SECTION  IS  ORGANIZED  INTO  MAJOR  PARTS  AS  FOLLOWS. 

•  (ii  variable  Initialization. 

•  USER  CONTROLLED  VARIABLES  ARE  SPECIFIED. 

•  (21  NETWORK  CONSTRUCTION. 

•  DATA  CONCERNING  NODES  AND  THEIR  CONNECTIVITY 

•  IS  INPUTTED  FROM  EXTERNAL  DATA  SET. 

’  (31  BEST  PATH  INITIALIZATION, 

•  THE  SIMULATION  IS  RUN  WITHOUT  ANT  MESSAGE  TRAFFIC 

'  (I.E.  UPDATES  QNLT'l  TO  DETERMINE  THE  BEST  PATH 

•  VALUES  WITH  WHICH  TO  BEGIN  THE  SIMULATION. 

’  (4)  EVENT  INITIALIZATION. 

’  PRIOR  TO  THE  start  of  the  simulation  all  events 

’  ARE  INITIALIZED. 

•  (SJ  START  SIMULATION, 

•  (61  MULTIPLE  RUN  OPTION, 

•  THE  SIMULATION  CAN  BE  RUN  AGAIN  USING  NEW  PARAMETERS 

•  IF  DESIRED. 

*•  SIMULATION  PROGRAM  CONTENTS, 

« 

’  1.  ..PREPARATION*  PRIOR  TO  SIMULATION  IP) 

•  1.1  Pi. BUILD. NETWORK  (ROUTINE! 

’  1.2  P2. CONNECT. LINKS  (ROUTINE) 

•  1.3  PS.  INITIAL. ROUTING'.  TABLE  (ROUTINE) 

•  1.4  P4. STATIC. EVENTS  (ROUTINE) 

-  l.S  PS. DTNAMIC. EVENTS  (ROUTINE) 


2U8 


.*  V  >  *  .* 


1.6  P6. PURGE. EVENT. QUEUE  (ROUTINE) 

1.7  P7rZ£RQIZE . SETS  (ROUTINE) 

2.  -UPOATE-  ROUTING  PROTOCOL  (U) 

2.1  Ul. GENERATE. UPDATE  (EVENT) 

2.2  U2. TRANSMIT. UPDATE  (ROUTINE) 

2.3  U3. INSERT. UPDATE  (ROUTINE) 

2.(1  U(l. RECEIVE. UPDATE  (EVENT) 

2.5  U5. LINK. HEIGHT. CALCULATION  (EVENT) 

2.6  U6. NODE. HAKE. UP  (EVENT) 

2.7  U7. UNIT. FIRING  (EVENT) 

2.6  U6. ERASE. RECORD  (EVENT) 

3.  -MESSAGE"  PACKET  TRANSPORT  (M) 

3.1  Ml. GENERATE. MESSAGE  (EVENT) 

3.2  M2. RECEIVE. MESSAGE. PACKET  (EVENT) 

1.  "EVALUATION-  OF  NETWORK  PERFORMANCE  (E) 


1.1  El. TRANSIENT. BLANKING  (EVENT) 

1.2  E2.  COLLECT.  DATA  (EVENT) 

1.3  E 3. PARAMETER. LI  STING  (ROUTINE) 

1.1  El. NETHORKiPERFORMANCE. REPORT  (EVENT) 

1.5  E5. BEST. PATH. ROUTING. TABLE  (ROUTINE) 

1.6  E6. LINK. HEIGHT. MATRIX  (ROUTINE) 

1.7  E7. TRAFFIC. DISTRIBUTION  (ROUTINE) 


GLOBAL  VARIABLE  DESCRIPTION!  (ALPHABETICAL  ORDER) 


AVE.PPM 
BEG. PPM 
BIT. INTERVAL 

BRACKET 


DELTA 


ERA. PERIOD 
FAH.  TIME- 
FH.FTRE 
FMLTS 


PACKETS  PER  MESSAGE  (AVERAGE  VALUE) 

PACKETS  PER  MESSAGE  (MINIMUM  VALUE) 

THE  INTERVAL  (IN  SECONDS)  OF  THE  DISCRETE  CLOCK 
HHICH  MAT  BE  USED  IN  THE  SIMULATION. 

THE  TIME  WINDOW  IN  WHICH  A  NODE  MAT 
GENERATE  AN  UPDATE  MESSAGE. 

BRACKET  HILL  EQUAL  .1  -  NOD. TIME. 

A  VALUE  (0  <  DELTA  <  I)  HHICH  DICTATES  THE 
MULTIPLICATION  FACTOR  USED  IN  WEIGHTING  THE 
LINKS  WHEN  A  NODE  IS  COMPUTING  THE  SETTING 
TIME  FOR  THE  'ALARM  CLOCK*  ASSOCIATED  WITH  AN 
UPDATE  MESSAGE. 

THE  TIME  LENGTH  FOR  WHICH  A  NODE  MAINTAINS  ITS 
RECORDS  OF  PREVIOUS  UPDATE  MESSAGE 'RETRANSMITS. 
SAME  AS  NOD. TIME  EXCEPT  CONCERNS  FAMILT 
UPDATES  BEING  GENERATED  BT  A  SINGLE  NODE. 

SAME  AS  GR.FIRE  EXCEPT  CONCERNS  FAMILY  MESSAGE. 
LET  FM.FIRE  »  MAX. FAM. NODES  -  U.XMN.TIME. 
THE  NUMBER  OF  FAMILIES. 
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V 


GP.F1RE  THE  TlHE  FROM  ORIGINATION  OF  A  GROUP  UPOATE 

WARNING  MESSAGE  BT  A  NODE,  AT  WHICH  ALL  NODES 
IN  THE  SAME  GROUP  SIMULTANEOUSLY  TRANSMIT  THE 
GROUP  UPOATE  MESSAGE.  THIS  TIME  ALLOWS  FOR 
THE  WARNING  MESSAGE  TO  PROPAGATE  TO  ALL  NODES 
IN  THE  GROUP. 

LET  GP.FIRE  ■  MAX. GRP. NODES  «  U.XMN.TIME. 

GRPS  THE  NUMBER  OF  GROUPS. 

GRP. TlHE  SAME  AS  NOD. TIME  EXCEPT  CONCERNS  GROUP 

UPDATES  BEING  GENERATED  BT  A  SINGLE  NODE. 

HOP. LIMIT  THE  MAXIMUM  NUMBER  OF  HOPS  WHICH  AN  UPDATE 

MESSAGE  CAN  TRAVEL  WITHIN  GROUPS  OR  FAMILIES 
NOT  WITHIN  THE  ORIGINATOR’S  BASIC  GROUP/FAM1LT. 
II. E.  USED  FOR  ESTABLISHING  BORDER  NODE  PATHS). 

IN. GROUP  THE  PERCENTAGE  OF  GENERATED  MESSAGES  THAT  WILL 

NOT  LEAVE  THE  BASIC  GROUP. 

IN. FAMILY  THE  PERCENTAGE  OF  GENERATED  MESSAGES  THAT  WILL 

NOT  LEAVE  THE  BASIC  FAMILY. 

LNK. NODE. RAT  10  THE  RATIO  OF  LINKS  TO  NODES  IN  THE  NETWORK. 

MAX. FAM. NODES  MAXIMUM  NUMBER  OF  NODES  PER  FAMILY. 

MAX. GRP. NODES  MAXIMUM  NUMBER  OF  NODES  PER  GROUP. 

MAX. LINKS. PER. NODE  THE  MAXIMUM  NUMBER  OF  LINKS  FOR  A  NODE 
IN  THE  NETWORK. 

MAX. PPM  PACKETS  PER  MESSAGE  (MAXIMUM  VALUE) 

NGFS  I#  OF  NODES)  ♦  I«  OF  GROUPS)  ♦  (•  OF  FAMILIES) 

NODE. FACTOR  A  NORMALIZATION  FACTOR  WHICH  ALLOWS  NETWORKS  OF 
DIFFERENT  SIZES  TO  BE  COMPARED  USING  THE 
AVERAGE  NUMBER  OF  PACKETS/SECOND/NODE  AS  A 
CONSTANT  MEASURE  OF  NETWORK  LOADING. FOR 
EXAMPLE,  IF  A  5  NODE  NETWORK  IS  USED  AS  THE 
COMPARISON  BASE  THEN  A  10  NODE  NETWORK  HAS  A 
NOOE. FACTOR  OF  2. 

THE  MINIMUM  LENGTH  OF  TIME  BETWEEN 
CONSECUTIVE  NODE  UPDATES  BEING  GENERATED 
BY  A  SINGLE  NODE. 

T Mr  TIME  WHEN  TRANSIENT  EFFECTS  ARE'ERASED  FROM 
THE"  ACCUMULATED  VARIABLES. 

NUM. OF. HEIGHTS  THE  NUMBER  OF  MOST  RECENT  WEIGHTS  CONSIDERED 
IN  THE  COMPUTATION  OF  THE  LINK  HEIGHT. 

NUM. REPORTS. REQUESTED  THE  NUMBER  OF  NETWORK  STATUS  REPORTS 

REQUESTED  DURING  A  SIMULATION  RUN. 

PKT.XMN.TIME  TIME  FOR  TRANSMISSION  OF  A  PACKET 
OVER  A  LINK  BETWEEN  TWO  NODES. 

PPS.BEG  PACKETS  PER  SECOND  (MINIMUM  VALUE) 

PPS.INC  -  *  (INCREMENT  *  ) 

PPS.ENO  "  (MAXIMUM  *  ) 

PPS.AVE  -  (AVERAGE  *  ) 

PRNT  AN  INTEGER  WHICH  CONTROLS  THE  LEVEL  OF 

DIAGNOSTIC  PRINTING. 

0  NETWORK  TOPOLOGY  *  INITIAL  DATA  ♦  NET. REPORTS 


N0D.T1MC 


MIL.  TRANS  IE  Nr 


U 
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-W,.' -  m ^  ' 


m 

,^, *  •  . 


/*« 


1  ■■•>  o  ♦ 

2  ■■■>  1  * 
3  — ->  2  ♦ 

QU.FACT 


SAMPLES 
TIME. LIMIT 

TRAF. LIMIT 

HT.TIME 

u.xmn.time 


TRACES  ALL  PACKETS 

ANNOUNCES  ALL  UPOATE  'HAKE  UPS’  HI TH  BEST  PATHS 
ANNOUNCES  ORIGINATION.  RELAT/ARRI VAL  OF 
ALL  UPOATE  MESSAGES*  ERASURE  OF  XMT.RECOROS 
HHEN  USING  THE  HEIGHTING  METHOD  'COMBINE*  He 
USE  A  COMBINATION  OF  THE  QUEUE  SIZE  NOH  ANO 
THE  UTILIZATION  FACTOR.  THE  MAX  VALUE  OF  THE 
UTILIZATION  FACTOR  TERM  IS  20.  THEREFORE  HE 
USE  OU.FACT  AS  A  SCALING  FACTOR  FOR  THE  VALUE 
OF  THE  QUEUE  SIZE  NOH  TERM. 

NUMBER  OF  OATA  POINTS  REOUESTEO  PER  RUN. 

THE  LENGTH  OF  TIME  FOR  HHICH  THE  SIMULATION 
LASTS. 

THE  MAXIMUM  NUMBER  OF  MESSAGES  GENERATEO 
OURING  A  SIMULATION  RUN. 

TIME  INTERVAL  FOR  HHICH  LINK  HEIGHTS  ARE  FOUNO. 
TIME  FOR  TRANSMISSION  OF  AN  UPOATE 
OVER  A  LINK  BETHEEN  TWO  NOOES; 


BEGINNING  OF  USER  CONTROLLED  PARAMETERS 


FIXEO  NETHORK  VALUES... 

NOT  SUBJECT  TO  CHANGE  HITHIN  THE  SIMULATION. 


LET  PKT.XMN.TIME  • 

let  u.xmn.time 
let  bit. interval  - 


0.05000 

0.00100 

0.000001 


VARIABLE  PARAMETERS... 

SUBJECT  TO  CHANGE  HITHIN  THE  SIMULATION. 


LET  NOO.TIME 

■ 

0.500 

LET  GRP.T1ME 

■ 

1.000 

LET  FAM.TIME 

■ 

2.000 

LET  OELTA 

■ 

0.00100 

LET  ERA.PERIOO 

■ 

1.000 

LET  HOP. LIMIT  ' 

■ 

0 

LET  IN. GROUP 

■ 

0.000 

LET  IN. FAMILY 

■ 

0.000 

LET  NOOE. FACTOR 

■ 

1 

**  SIMULATION  RUN  PARAMETERS... 
«  « 

LET  TIME. LIMIT  «  30.000 
LET  TRAF. LIMIT  -  100000 
LET  NUL. TRANSIENT  -  5.0 


•*.  * 
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••  REPORTING  AND  OflTfl  COLLECTION  PARAMETERS. 
«  • 

LET  SAMPLES  ■  30 
LET  NUM. REPORTS. REQUESTED  -  1 
LET  PRNT  -  0 


-  -TEST  ROUTING  - 


*  <AL I  VE/DEAD)  SET  WHEN  THE  BEST  PATHS  TO  A  GIVEN  NOOE  ARE 
DESIRED.  THE  SIMULATION  STOPS  AFTER  THESE  PATHS  ARE  FOUND. 


LET  TEST 
LET  TST.NOOE 


ET  STATIC. BP  -  DEAD 


STATIC  ROUTING 


STATIC. BP  t  (ALI VE/OEAOl  SET  WHEN  THE  SIMULATION  IS  TO  BE  RUN 

USING  STATIC  ROUTING  BASED  UPON  THE  INITIAL  BEST  PATHS 
08TAINE0  VIA  THE  INITIAL  LEAST  HOPS  METHOD. 


DYNAMIC  ROUTING  - 


MANNER  OF  WEIGHTING  MAT  BE  i 


LET  MANNER. OF. WEIGHTING 

LET  QU.FACT 

LET  NT. TIME 

LET  NUM. OF.  HEIGHTS 


m  by .qsize.noh 

(2)  BT.PAST.OSIEE 

(3)  BY.PAST.QAVG 

(4)  BY. RHO. HEIGHT 
(51  BY. COMBINE 


BY. COMBINE 

1.00 

PKT.XMN.TIME  «  7.5 
10 


-  MULTIPLE  SIMULATION  RUN  PARAMETERS  - 

ir  none  of~ihe  special  options  below  are  SELECTEO  THEN  THE  program 

IS  RUN  WITH  THE  DEFAULT  MULTIPLE  RUNS  INVOLVING  VARYING  THE 
PACKETS  PER  SECOND  AND  THE  PACKETS  PER  MESSAGE  FOR  THE  NETWORK. 


OPTION  li 


VARYING  THE  NUMBER  OF  HEIGHTS 


LET' STEP. BY. HEIGHTS  -  DEAD 

’*  THE  STARTING  VALUE  IS  GIVEN  BY  THE  VARIABLE  NUM. OF. WEIGHTS. 
LET  HT. STEPS  -  3 

LET  HT. FINISH  -  13 


V.v. 

.  *.v 
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”  OPTION  2t  VARYING  THE  TIME  BETWEEN  NODE  UPORTES. 

•  • 

LET  ST.EP.8T.N00.T1ME  -  DEAD 

’’  THE  STARTING  VALUE  IS  GIVEN  BT  THE  VARIABLE  NOD. TIME. 
LET  NO. STEPS  -  0. 25 

LET  NO.FINISH  -  I.S 


.. - VIRTUAL  CIRCUITS - : - 

%  < 

"  THE  SIMULATION  MAT  BE  RUN  USING  VIRTUAL  CIRCUITS  (WHEREBY  ALL 
"  PACKETS  BELONGING  TO  THE  SAME  MESSAGE  TAKE  THE  SAME  ROUTE)  OR 
’’  NOT  (HHEREBT  PACKETS  TRAVEL  ACCORDING  TO  CURRENT  BEST  PATH 
"  INFORMATION  AND  PACKETS  BELONGING  TO  THE  SAME  MESSAGE  MAY 

’’  INDEED  TAKE  DIFFERENT  ROUTES). 

«  « 

LET  USE. VIRT. CRTS  -  DEAD 

’’  . .  DISCRETE  TIMER  - - - 

«  • 

”  THIS  OPTION  ALLOWS  THE  SIMULATION  TO  BE  RUN  USING  A  DISCRETE 
**  CLOCK  SYSTEM  WHICH  ACCOUNTS  FOR  THE  SYNCHRONIZATION  PRESENT 
”  IN  THE  NETWORK.  BASICALLY  A  NODE  IS  ONLY  ALLOWED  TO  TRANSMIT 
*•  EITHER  UPDATE  OR  MESSAGE  PACKETS  AT  SPECIFIC  DISCRETE  POINTS 
*•  IN  TIME.  ALL  NODES  ARE  "SYNCHRONIZED"  AT  THE  START  OF  THE 
••  SIMULATION  AND  THEREAFTER  THE  CLOCK  '"PERIOD"  IS  SET  EQUAL  TO 
•*  THE  TIME  IT  TAKES  FOR  AN  UPDATE  PACKET  TO  BE  SENT.  THUS  ALL 
••  PACKETS  HILL  BE  TRANSMITTED  AT  TIMES  EQUAL  TO  N  «  U.XMN.T1ME 
•*  (WHERE  N  IS  AN  INTEGER). 

LET  DISCRETE. TIMER  •  DEAD 
«  « 

*’  -  SYNCHRONIZED  group/family  UPDAYE  xmys  - 

«  % 

••  yhe  simulation  can  be  run  under  the  system  where  group  and  family 

••  UPDATE  MESSAGES  ARE  SIMULTANEOUSLY  SENT  BY  BORDER  NODES  OF  THE  BASIC 
"  UNIT  TO  "OUTSIDE’  NODES.  THIS  IS  BASED  UPON  A  SYNCHRONIZED  SCHEDULE 
”  OF  UPOATE“"FIRINGS""HHICh  do  not  require  the  warning  messages  THAT 
”  NOTIFY  OF  FUTURE  UPDATE  TIMES  UNDER  THE  STANDARD  SCHEME. 

”  THIS  GREATLY  REDUCES  THE  UPDATE  OVERHEAD  DUE  TO  ’FLOODING’  OF 

”  WARNING  MESSAGES  WITHIN  THE  BASIC  UNIT. 

«  « 

LET  SYNCH. FIRING  -  DEAD 
*  « 

’’  -  TRAFFIC  PARAMETERS  - 


LET  PPS.BEG 
LET  PPS.INC 
LET  PPS.ENO 


100.  *  REAL. F  (NODE. FACTOR) 

IDO.  «  REAL. F  (NODE. FACTOR) 

500.  «  REAL. F  (NODE. FACTOR) 


THE  SIMULATION  HAT  BE  RUN  USING  EITHER  A  UNIFORM  OR  A  GEOMETRIC 
OISTRIBTION  FOR  THE  NUMBER  OF  PACKETS  PEP  MESSAGE.  IF  A  UNIFORM 
DISTRIBUTION  IS  SELECTED  THEN  THE  PPM  VARIABLE  BELOM  IS  THE 
MAXIMUM  VALUE  FOR  THE  UNIFORM  DISTRIBUTION  OF  MESSAGE  LENGTHS 
CI.E.  THE  MESSAGE  LENGTHS  HILL  VART  UNIFORMLT  FROM  1  TO  PPM  PACKETS 
IN  LENGTH)  .  THEREFORE  THE  AVERAGE'  MESSAGE  LENGTH  HILL  BE 
(PPM  ♦  l)/2  PACKETS  LONG.  IF  THE  GEOMETRIC  DISTRIBUTION  IS 
SELECTED  THEN  THE  PPM  VARIABLE  CORRESPONDS  TO  THE  AVERAGE  LENGTH 
OF  A  MESSAGE  IN  PACKETS. 


LET  BT.GEOM.OIST  «  ALIVE 


LET  BEG. PPM 
LET  INC. PPM 
LET  END. PPM 


END  OF  USER  CONTROLLED  PARAMETERS 


COMPUTE  THE  NUMBER  OF  RUNS  HHICH  HILL  BE  MADE 


LET  I  PPM  -  1 

LET  XCOUNT  •  BEG. PPM 

"Run. ppm* 

LET  XCOUNT  -  XCOUNT  ♦  INC. PPM 
IF  XCOUNT  <•  ENO. PPM, 

LET  IPPM  •  IPPM  ♦  1 
GO  RUN. PPM 
REGAROLESS 
LET  I MSG  -  1 
LET  XCOUNT  •  PPS.BEG 
"RUN. MSG" 

LET  XCOUNT  -  XCOUNT  ♦  PPS. INC 
IF  XCOUNT  <•  PPS. ENO, 

LET  I  MSG  -  I  MSG  ♦  1 
GO  RUN. MSG 
REGAROLESS 

LET  NUHRUNS  •  IPPM  *  I  MSG 


IF  STEP. BT. HEIGHTS  -  ALIVE, 

LET  NUMRUNS  •  1 

LET  XCOUNT  •  NUM. OF. HEIGHTS 

"HT.HERE" 

LET  XCOUNT  -  XCOUNT  ♦  HT. STEPS 
IF  XCOUNT  >  HT. FINISH, 

GO  UT.ENO 
REGAROLESS 

LET  NUMRUNS  -  NUMRUNS  ♦  1 
GO  HT.HERE 


•WT.ENO 

REGARDLESS 
«  « 

IF  ST.EP.8T.NC0.T1ME  -  ALIVE, 

LET  NUMRUNS  -  1 
LET  XCOUNT  -  NOD. TIME 
•NO. HERE* 

LET  XCOUNT  -  XCOUNT  ♦  NO. STEPS 
IF  XCOUNT  >  NO. FINISH. 

GO  NO. END 
REGARDLESS 

LET  NUMRUNS  -  NUMRUNS  ♦  1 
GO  NO. HERE 
•NO. END* 

REGARDLESS 
•  % 

USE  UNIT  8  FOR  OUTPUT 
WRITE  NUMRUNS  AS  1  S 

USE  UNIT  6  FOR  OUTPUT 
•  • 

perform  pi. BUILD. network 

RELEASE  PI. BUILD. NETWORK 
•  • 

••  THE  INITIAL  VALUES  FOR  THE  FIRST  SIMULATION  RUN  ARE  COMPUTED. 
«  • 

LET  GP.F'lRE  -  MAX. GRP. NODES  «  U.XMN.TIME 

LET  FM.F1RE  -  MAX.FAM.NOOES  «  U.XMN.TIME 

LET  BRACKET  «  NOO.TIME  *  0.1 

'  ' 

LET  PPS.AVE  -  RPS.BEG 
LET  MAX. PPM  -  BEG. PPM 
LET  AVE.PPM  -  (1.0  ■*  MAX. PPM)  /  2. 

IF  BT.GE0M.01ST  -  ALIVE, 

LET  AVE.PPM  -  MAX. PPM 
REGARDLESS 

LET  MSG. GENERATION. INTERVAL  •  AVE.PPM  /PPS.AVE 
•  • 

••  “TEST  “PROCEDURE 
IF  TEST  -  ALIVE, 

LET  TIME. LIMIT  «  100.0 

LET  1N1T.8P  -  ALIVE 
LET 'DELTA  «  1.0 
LET  U.XMN.TIME  «  0.0 

SCHEDULE  A  U1 .GENERATE. UPDATE  GIVEN  TST.NOOE.  NOD. MSG  AT  0.0 
GO  RUN. IT 

REGARDLESS 
«  • 

LET  I  NIT. BP  -  ALIVE 
•  • 

PERFORM  PS. initial. routing. table 


V 


GO  RUN. IT 


'BEGIN. SIMULATION  * 

« « 

"  INITIALIZE  THE  BEST  PATH  MATRIX. 

« « 

FOR  1  -  1  TO  NGFS,  00 

FOR  J  -  1  TO  NGFS,  DO 

LET  BEST.  PATH  (l.J)  •  OUP.  BEST  .PATH  (1 .  J) 

LOOP 

LOOP 
«  % 

'SET. UP' 

«  « 

"  RECORO  PLOT  INFORMATION  PRIOR  TO  DATA  COLLECTION. 

«  « 

USE  UNIT  a  FOR  OUTPUT 

MR1TE  SAMPLES.  N.NOOE.  LINKS,  OELTA,  PPS.AVE.  AVE.PPH. 

NOD. TIME,  IN. GROUP.  1N.FAM1LT.  STATIC. BP. 

MANNER. OF. WEIGHTING.  NUM. OF . HE  1 GHTS.  HT.TIME, 

U.XMN.TIME.  PKT.XMN.T1ME.  BIT. INTERVAL.  PR. COLLISION. 

USE. V1RT . CKTS,  01SCRETE.T1MER.  BT. COLLISION.  BT.GE0M.D1ST 
AS  /.B  1.3  I  S.3  0(10.6)./. 8  1.3  0(10. 3). 1  I  5./.B  1. 

2  1  S.l  0(10. 6). /.B  1.4  0(10.61.4  1  3 

USE  UNIT  6  FOR  OUTPUT 
«  « 

”  RUNNING  THE  SIMULATION  USING  STATIC  BEST  PATHS 
«  « 

IF  STATIC-.BP  ■  ALIVE 

PERFORM  P4. STATIC. EVENTS 
GO  RUN. IT 
REGARDLESS 


PERFORM  P5.0TNAMIC. EVENTS 
•  « 

'RUN.  17’ 

«  « 

START  SIMULATION 
•  « 

IF  TEST  ■  ALIVE. 

PERFORM  ES. BEST. PATH. ROUTING. TABLE 
GO  ENO.IT 

REGARDLESS 
•  « 

IF  1NIT.BP  «  ALIVE 

PERFORM  E5 . BEST . PATH . ROUT  I NG.7  ABLE 
PERFORM  P6. PURGE. EVENT. QUEUE 
PERFORM  P7. ZEROIZE. SETS 


LET  PRNT  -  0 

LET  INIT.BP  -  DEAD 
PERFORM  E 3 . PARAMETER .LISTING 
GO  SET. UP 
REGARDLESS 

I  • 

PERFORM  P7. ZEROIZE, SETS 
•  « 

••  THE  SIMULATION  MAT  BE  RUN  USING  A  DIFFERENT  NUMBER  DF  WINDOWS  FOR 
"  COMPUTING  THE  WEIGHTS  OF  THE  LINKS.  IN  THIS  WAT  ONE  CAN  SEE  THE 

"  EFFECTS  OF  VARTING  WEIGHT  LENGTHS  IN  THE  OPERATION  OF  THE  STSTEM. 
•  « 

IF  STEP. BT. HEIGHTS  -  ALIVE, 

«  % 

LET  NUM. OF. HEIGHTS  -  NUM. OF. WEIGHTS  *  WT. STEPS 
IF  NUM. OF. HEIGHTS  >  HT. FINISH. 

GO  END. IT 
REGARDLESS 
GO  BEGIN. SIMULATION 
REGARDLESS 

"  THE  SIMULATION  MAT  BE  RUN  USING  A  DIFFERENT  TIME  BETWEEN 
••  NODE  UPDATES.  IN  THIS  HAT  ONE  CAN  SEE  THE  EFFECTS  OF  CHANGING 

*’  THE  'SPEED*  AT  WHICH  THE  NETWORK  PRODUCES  ROUTING  INFORMATION. 

%  « 

IF  ST.EP.BT.NOD.7IME  -  ALIVE, 

«  « 

LET  N00.7IME  -  NOD. TIME  ♦  NO. STEPS 
IF  NOD .7 1  ME  >  NO. FINISH. 

GO  END. IT 
REGARDLESS 
GO  BEGIN. SIMULATION 

REGARDLESS 
•  % 

"  THE  SIMULATION  CAN  BE  REPEATED  USING  A  CHANGING  MESSAGE 
'*  GENERATION  INTERVAL  CONTROLLED  BT  AN  INCREMENTAL  SUM.  IN  THIS 
"  -MANNER  THE  NETWORK  CAN  BE  TESTED  UNDER  DIFFERENT  TRAFFIC  LOAD 

"  CONDITIONS  WHILE  HOLDING  CONSTANT  THE  OTHER  NETWORK  PARAMETERS.- 
«  « 

LET'PPS.AVE  -  PPS.AVE  ♦  PPS.INC 
«  « 

IF- PPS. AVE  <-  PPS.ENO. 

«  • 

LET  MSG.GENERATION. INTERVAL  -  AVE. PPM  /  PPS.AVE 
GO  BEGIN. SIMULATION 

REGARDLESS 
«  « 

"  AFTER  THE  SIMULATION  IS  PERFORMED  USING  DIFFERENT  MESSAGE 
"  GENERATION  INTERVALS.  THE  SIMULATION  CAN  BE  RUN  AGAIN  USING 
”  A  NEW  VALUE  FOR  EITHER  THE  MAXIMUM  PACKETS  PER  MESSAGE  ALLOWED 
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*•  (IF  A  UNIFORM  DISTRIBUTION  FOR  MESSAGE  LENGTHS  IS  USED)  OR  ft 
••  NEN  VALUE  FOR  THE  AVERAGE  MESSAGE  CENGTH  (IF  A  GEOMETRIC 

••  DISTRIBUTION  FOR  MESSAGE  LENGTHS  IS  USED). 

«  • 

LET  PPS.AVE  -  PPS.BEG 

LET  MAX. PPM  -  MAX. PPM  ♦  INC. PPM 
«  « 

IF  MAX. PPM  <«  END. PPM. 

«  t 

LET  AVE.PPM  -  WAX. PPM  *1.01/2. 

«  • 

IF  8T.GE0M. DIST  -  ALIVE. 

LET  AVE.PPM  -  MAX. PPM 
REGARDLESS 

LET  MSG. GENERATION. INTERVAL  «  AVE.PPM  /  PPS.AVE 
GO  BEGIN. SIMULATION 
REGAROLESS 
'END. IT  * 

STOP 

«  t 

END  "OF  MAIN 


ROUTINE  FOR  PI .BUILD. NETWORK 
«  « 

"  THIS  ROUTINE  INITIALISES  ALL  THE  VARIABLES  WHICH  ARE  INVOLVED 

"  IN  THE  ACTUAL  CONSTRUCTION  OF  THE  NETWORK. 

«  « 

'*  THIS  ROUTINE  IS  CALLED  FROM  ’MAIN*. 

DEFINE  GRPCQUNT ,  FAMCOUNT  AS  REAL  VARIABLES 
%  % 

READ  N. NODE 
•  « 

START  NEW  PAGE 
SKIP  5  LINES 

PRINT  6  LINES  AS  TOLLOWS 

NETWORK  TOPOLOGY  »««>■•••»•>••>•*• 


NODE  TRANSMIT  RECEIVE  GROUP  FAMILY  OPTIONAL 

NO.  FACTOR  FACTOR  (PGM  •  )  (PGM  •)  RECEIVER 

«  * 

SKIP  1  LINE 
CREATE  EVERT  NODE 
FOR  EVERT  NOOE 

READ  XMT.  PERCENT  (NOOE)  ,  RCV.  PERCENT  (NOOE)  .  GROUP  (NODE)  .  FAMILY  (NODE)  , 
OPT.RCV  (NODE) 

«  « 


TRNS.PCNT  AND  RCV.PCNT  ARE  THE  SUM  OF ’TRANSMIT  AND  RECEIVE  FACTORS 


••  THESE  VALUES  ARE  USED  WHEN  UNBALANCED  TRAFFIC  PATTERNS  ARE  DESIRED. 
”  GROUP  NUMBERS  ARE  ADOED  TO  N.NODE  TO  GET  PROGRAM  GROUP  NUMBERS. 

••  FAMILY  NUMBERS  ARE  AODED  TO  N.NODE  ♦  THE  HIGHEST  GROUP  NUMBER  TO  GET 
••  THE  PROGRAM  FAMILY  NUMBER. 

’*  THE  OPTIONAL  RECEIVER  FOR  EACH  NODE  IS  A  DEDICATED  RECEIVING  NODE 
••  FOR  ALL  TRAFFIC  TRANSMITTED  BY  THAT  NODE.  FOR  EXAMPLE  IF  THE 
••  OPTIONAL  RECEIVER  OF  NODE  3  IS  NODE  7  THEN  ANT  TRAFFIC  ORIGINATING 
•*  FROM  NODE  3  HILL  BE  DESTINED  FOR  NODE  7.  IN  THIS  HAT  SPECIFIC 
**  IMBALANCED  LOAO  CONDITIONS  CAN  BE  SIMULATED.  IF  NO  OPTIONAL 
’•  RECEIVER  IS'  STATEO  THEN  THE  VALUE  IS  2ERO. 

••  HITHIN  THE  SIMULATION  GROUPS  AND  FAMILIES  ARE  HANDLED  AS  IF 
*•  THEY  HERE  SUPER-NODES.  A  USEFUL  ANALOGY  IS  TO 
*•  ENVISION  MANT  SUB-NODES  HITHIN  A  GROUP  OR  FAMILY  SUPER- 

••  node,  access  to  the  sub-nodes  is  controlled  by  the 

••  THE  SUPER-NOOE'S  ADDRESS. 

•  • 

LET  GRPS  -  NONE 

LET  FMLTS  -  NONE 

LET  NGFS  -  NONE 

LET  GRPCOUNT  -  0.0 

LET'FAMCOUNT  ■  0.0 

•  • 

FOR  EVERT  NOOE.  00 

LETTRNS.PCNT  -  TRNS.PCNT  ♦  XMT. PERCENT  (NODE) 

LET  RCV.PCNT  -.RCV.PCNT  ♦  RCV. PERCENT  (NODE) 

IF  GRPS  <  GROUP  (NOOE)' 

LET  GRPS  -  GROUP  (NODE) 

REGAR0LES5 

•  » 

”  SET  PROGRAM  GRP. NUM 

«  I 

LET  GROUP  (NOOE)  -  GROUP  (NOOE)  *  N.NODE 

LOOP 

•  I 

RESERVE  'FAM.OF. GRP  (*)  AS  (GRPS  ♦  N.NODE  *  25) 

•  I 

FOR ’EVERY  NOOE.  00 

IF  FMLT-S  <  FAMILT  (NODE) 

LET  FMLTS  ■  FAMILT  (NODE) 

REGAROLESS 

•  • 

•*  SET  PROGRAM  FAM  NUM 
•  « 

LET-FAMILY  (NODE)  -  N.NODE  *  GRPS  ♦  FAMILY  (NODE) 

LET  FAM. OF. GRP  (GROUP  (NODE) )  -  FAMILY  (NOOE) 

LOOP 
•  « 

LET  NGFS  •  N.NODE  *  GRPS  ♦  FMLTS 

reserve"best:path(«.p<i  as  ngfs  bt  ngfs 


RESERVE  OUP. BEST. PATH (x,k)  as  NGFS  BT  NGFS 
•  « 

THE  FOLLOWING  ARRAYS  ARE  USED  TO  HOLD  INFORMATION  CONCERNING 
THE  STATISTICS  ON  THE  TRAFFIC  BETWEEN  NODE  PAIRS. 

•  « 

RESERVE  BORN.PKTS  tx,  x)  AS  N.NOOE  BY  N.NOOE 

RESERVE  GONE.PKTS  tx,  x)  AS  N.NOOE  BY  N.NOOE 

RESERVE  JUMP. TOTAL  Ik, x)  AS  N.NOOE  BY  N.NOOE 

RESERVE  LENGTH. TRIPIk.k)  AS  N.NODE  BY  N.NOOE 
«  « 

FOR  EVERY  NOOE.  00 

PRINT  1  LINE  WITH  NOOE.  XMT. PERCENT  (NOOE) .  RCV. PERCENT (NODE)  . 
(GROUP  (NODE)  -  N.NODE),  GROUP  (NODE)  . 

(FAMILY  (NOOE)  -  N.NODE  -  GRPS)  AND  FAMILY  (NODE)  , 

OPT. RCV  (NOOE)  AS  FOLLOWS 

""  KK.KKK  KK.KKK  KX(mK)  KK  (KK)  MMX 

SKIP  1  LINE 

LOOP 

SKIP  I  LINE 
•  % 

COMPUTING  THE  MAXIMUM  NUMBER  OF  N0OES  PER  GRP  AND  NODES  PER  FAM. 

LET  MAX. GRP. NODES  •  0.0 

LET  MAX.FAM.NOOES  •  0.0 

•  « 

FOR  I  -  N.NOOE  ♦  1  TO  N.NOOE  ♦  GRPS,  00 

FOR  EACH  NOOE,  WITH  GROUP  (NOOE)  -  I.  00 

COMPUTE  GRPCOUNT  AS  THE  NUMBER  OF  GROUP (NODE) 

LOOP 

IF  MAX.GRP.NOOES  <  GRPCOUNT, 

LET  MAX.GRP.NOOES  ■  GRPCOUNT 
REGAROLESS 

LOOP 
«  < 

FOR  J  ■  N.NOOE  ♦  GRPS  ♦  1  TO  NGFS,  00 

FOR  EACH  NOOE,  WITH  FAMILY  (NODE)  ■  J,  00 

COMPUTE  FAMCOUNT  AS  THE  NUMBER  OF  FAMILY (NOOE) 

LOOP 

IF  MAX.FAM.NOOES  <  FAMCOUNT, 

LET  MAX.FAM.NOOES  ■  FAMCOUNT 
REGAROLESS 

LOOP 


PERFORM  P2. 'CONNECT.  LINKS 

RELEASE  P2. CONNECT. LINKS 
•  • 

PERFORM  E6.LINK. HEIGHT. MATRIX 
»  « 

RETURN 


ENO  "OF  PI .BUILD. NETWORK 


ROUTINE  FOR  P2. CONNECT. LINKS 
•  * 

••  "THIS  ROUTINE  HANDLES  THE  ASSIGNMENT  OF  LINKS  FOR  EACH  NODE 
”  II. E.  THE  ESTABLISHMENT  OF  THE  BASIC  NETWORK  TOPOL0GT) . 

”  THIS  ASSIGNMENT  IS  ACCOMPLISHED  THROUGH  THE  USE  OF  SETS. 

"  EACH  NODE  OWNS  A  LINK  SET  WHICH  CONTAINS  THE  IDENT1TT  OF 

”  ALL  NEIGHBOR  NOOES. 

«  • 

•’  VARIABLE  DESCRIPTION! 

"  LINKS  TOTAL  NUMBER  OF  LINKS  FOR  THE  NETWORK 

M  (ALL  LINKS  ARE  FULL-OUPLEX) 

DEFINE  FIRST. NODE,  SECOND. NODE.  QFST.  QSEC  AS  VARIABLES 
«  « 

READ  LINKS 

LET  LNK.NOO. RATIO  -  REAL. F  (2*LINKS) /REAL. F  (N. NODE) 

«  « 

FOR  1  -  1  TO  LINKS  DO 

READ  FIRST. NODE.  SECOND. NODE,  QFST.  QSEC 
CREATE  A  LINK 

LET  STATUS  (LINK)  •  IDLE 

LET  TERM  (LINK)  «  SECOND. NODE 

LET  QTEST  (LINK)  -  QFST 

LET  UPCOUNT  (LINK)  -  NONE 

FILE  LINK  IN  LINK. SET  (FIRST. NODE) 

CREATE  A  LINK 

LET  STATUS  (LINK)  -  IDLE 

LET  "TERM  (LINK)  -  FIRST. NODE 

LET  QTEST  (LINK)  -  QSEC 

LET  UPCOUNT  (LINK)  -  NONE 

FILE  LINK  IN  LINK. SET  (SECOND. NODE) 

LOOP 
*  • 

LET  max. links. per. node  ■  0.0 

FOR  EACH  NODE,  00 

IF  MAX. LINKS. PER. NODE  <  REAL .F  (N. LI NK. SET  (NODE) ) 

LET  MAX. LINKS.PER. NODE  -  REAL. F  (N. LINK. SET  (NODE) ) 

REGARDLESS 

LOOP 

RETURN 

ENO  ”0F"P2. CONNECT .LINKS 

*  *  HMXMMMMMMMMMMMMMMMMMNMMMMMMMMMMMMMMMNMMMMMMMMMMMMMMMMMMMMMMMMIOtMM 

,  , 

ROUTINE  FOR  P3. initial. routing. table 


REGARDLESS 

IF  FAMILT  (NODE)  IS  NOT  EQUAL  TO  SAME. FAMILY, 

HAVE  ONLY  ONE  NODE  PER  FAMILY  GENERATE  A  FAMILY  UPDATE. 

LET  NOD. WAIT  -  UNIFORM. F (O.O. BRACKET. 6) 

SCHEDULE  A  Ul. GENERATE. UPDATE  GIVEN  NODE.  FAM.MSG  IN 
NOO.MAIT  UNITS 

LET  SAME. FAMILY  ■  FAMILY (NODE) 

REGARDLESS 
’TRY. AGAIN’ 


LOOP 
%  • 

RETURN 

END  •'’OF  PS.  INITIAL. ROUTING. TABLE 


«  • 


ROUTINE  FOR  PM. STATIC. EVENTS 
«  » 

”  THIS  ROUTINE  IS  USEO  FOR  RUNNING  THE  SIMULATION  USING  STATIC 
”  ROUTING  AS  DETERMINED  8r  THE  INITIAL  BEST  PATH  MATRIX  DETERMINED 

”  PRIOR  TO  THE  START  OF  THE  RUN. 

•  • 

”  PACKET  MESSAGES  ARE  GENERATED  USING  AN  EXPONENTIAL  INTERARRIVAL 

”  RATE. 

•  % 

SCHEDULE  A  Ml. GENERATE. MESSAGE  GIVEN  REGULAR  IN 
EXPONENTIAL. F (MSG. GENERATION. INTERVAL. 8)  UNITS 

•  % 

”  DATA  IS  COLLECTED  AT  REGULAR  TIME  INTERVALS. 

«  t 

SCHEDULE  A  E2. COLLECT. DATA  IN  (TIME. LIMIT/REAL. F  (SAMPLES) I  UNITS 
•  « 

”  REPORT  DATA  SUMMARIES  MAT  BE  REQUESTED  AT  THE  USER’S  DESCRETION. 

«  « 

SCHEDULE  A  EM. NETWORK. PERFORMANCE. REPORT  IN 

(TIME. LIMIT/REAL. F  (NUM. REPORTS.  REQUESTED) )  UNITS 

%  % 

”  THE  TRANSIENT  EFFECT  OF  THE  NETWORK  IS  ELIMINATED  AFTER  10  SECONDS 
•  • 

SCHEDULE  A  El. TRANSIENT. BLANKING  IN  NUL. TRANSIENT  UNITS 

«  I 

RETURN 

ENO  ’-OF  PM.  STATIC. EVENTS 


ROUTINE  FOR  PS.  DYNAMICS  VENTS 


”  THIS  ROUTINE  SCHEDULES  EXACTLY  ONE  UPDATE  MESSAGE  FOR  EACH  NODE, 

”  GROUP.  AND  FAMILY  WITHIN  THE  NETWORK.  IN  THIS  HAY.  THE  INITIAL 
”  BEST  PATH  MATRIX  CAN  BE  OBTAINED  BY  RUNNING  THE  SIMULATION 
’’  (WITHOUT  ADDITIONAL  TRAFFIC  BEING  GENERATED) .  DURING  SUBSEQUENT 
’’  RUNS.  THIS  BEST  PATH  MATRIX  IS  USED  AS  THE  INITIAL  ROUTING 

”  CONDITION  FOR  THE  NETWORK. 

•  « 

DEFINE  SAME. GROUP.  SAME. FAMILY  AS  VARIABLES 

DEFINE  NOD. WAIT,  GRP. WAIT.  F AM. WAIT  AS  REAL  VARIABLE 
•  • 

LET  SAME. GROUP  >  NONE 
LET  SAME. FAMILY  -  NONE 

LET  GRP. WAIT  «  UNIFORM. F  (0. D. BRACKET, 2) 

LET  FAM.HAIT  -  UNIFORM. F  (D. D. BRACKET, 3) 

•  9 

SKIP  2  LINES 

FOR  EACH  NODE,  DO 

•  • 

LET  NOD. WAIT  -  UNIFORM. F  (O.D, BRACKET. 6) 

SCHEDULE  A  U1 .  GENERATE. UPDATE  GIVEN  NODE.  NOD. MSG  .IN 
NOO.HAIT  UNITS 

•  • 

IF  GRPS  -  1. 

GO  TRY. FAMILIES 
REGAROLESS 

IF  SYNCH. FIRING  -  ALIVE. 

SCHEOULE  A  U7. UNIT. FIRING  GIVEN  NODE,  GRP. MSG,  GROUP  (NODE) . 

GRP. WAIT  IN  GRP. WAIT  UNITS 
GO  TRY. FAMILIES 
REGARDLESS 

IF-  GROUP  (NOOE)  IS  NOT  EQUAL  TO  SAME.GROUP. 

•  • 

**  HAVE  ONLY  ONE  NODE  PER  GROUP  GENERATE  A  GROUP  UPDATE  MESSAGE. 

»  • 

LET  NOD. WAIT  -  UNIFORM. F  (D.D, BRACKET, 6) 

SCHEOULE  A  Ul. GENERATE. UPDATE  GIVEN  NODE.  GRP. MSG  IN 
NOO.HAIT  UNITS 

*  » 

LET  SAME.GROUP  -  GROUP  (NODE) 

•  « 

REGAROLESS 
’TRY. FAMILIES’ 

I  » 

IF  FMLYS  -  I. 

GO  "TRY. AGAIN 
REGAROLESS 

IF  SYNCH. TIRING  «  ALIVE, 

SCHEOULE  A  U7. UNIT. FIRING  GIVEN  NODE,  FAM.MSG,  FAMILY  (NODE) . 

F^.HAIT  IN  FAM.HAIT  UNITS 
GO  TRY. AGAIN 


••  THIS  ROUTINE  SETS  THE  'STAGE*  FOR  THE  START  OF  THE  SIMULATION 

"  BT  SCHEDULING  ALL  INITIAL  EVENTS. 

«  « 

OEF1NE  NN.T1ME.  GG.TlHE.  FF.TIHE.  GRP. WAIT.  FAM.HA1T  AS  REAL  VARIABLES 
DEFINE  SAME. GROUP.  SAHE.FAHILT  AS  VARIABLES 
•  •  , 

LET  SAME. GROUP  -  NONE 
LET  SAHE.FAHILT  >  NONE 

LET  GRP. HA IT  -  UNlFORH.F  (0. 0,  GRP.U  ME.2) 

LET  F AH. WAIT  -  UNlFORH.F  (0.0. FAH.TIHE.3I 
•  « 

FOR  EACH  NOOE.  00 
«  • 

LET  NN.T1HE  ■  UNlFORH.F  (0.0. N00.T1HE. 21 
LET  GG.'TlME  •  UNlFORH.F  (0.0. N00.T1HE. 7) 

LET  FF.TlME  •  UNlFORH.F  (0.0. N00.11HE. 9) 

«  « 

IF  0ISCRETE.T1HER  -  ALIVE. 

LET  NN. TIME  •  (TRUNC.F  (NN. TIME/BIT. INTERVAL)  «  BIT. INTERVAL) 

♦  U.XMN.TIHE 

LET  GG.TIME  ■  (TRUNC.F  (GG. TIME/BIT. INTERVAL)  «  BIT. INTERVAL) 

♦  U.XMN.TIHE 

LET  FF ."TIME  -  (TRUNC.F  (FF  .T 1ME/B1 T.  INTERVAL)  «  BIT.  INTERVAL) 

♦  U. XNN. TIME 

REGAROLESS 

«  • 

SCHEDULE  A  Ul. GENERATE. UPOATE  GIVEN  NOOE.  NOD. MSG  IN 
NN.TIHE  UNITS 

«  « 

IF  GRPS  -  1. 

GO  TRT. FAMILIES 
REGAROLESS 

IF  SYNCH, FT  RING  -  ALIVE. 

SCHEOULE  A  U7. UNIT. FIRING  GIVEN  NOOE.  GRP. MSG.  GROUP  (NODE) . 

GRP. WAIT  IN  GRP. WAIT  UNITS 
GO  TRT. FAMILIES 
REGAROLESS 

IF  GROUP  (NOOE)  IS  NOT  EQUAL  TO  SAME. GROUP 

«  « 

•*  HAVE  ONLY  ONE  NOOE  PER  GROUP  BE  THE  GENERATOR  OF 

”  GROUP  WARNING  MESSAGES. 

«  * 

SCHEOULE  A  Ul. GENERATE. UPDATE  GIVEN  NOOE.  GRP. MSG  IN 
GG.TIME  UNITS 

•  * 

LET  SAME. GROUP  «  GROUP (NOOE) 

*  « 

REGAROLESS 
’TRY. FAMILIES' 


IF  FHLTS  -  1. 

GO  TRY. AGAIN 
REGARDLESS 

IF  SYNCH. FIRING  -  ALIVE. 

SCHEDULE  A  U7. UNIT. FIRING  GIVEN  NODE.  FAH.MSG.  FAMILY  (NODE) . 

FAN. WAIT  IN  FAM.WAIT  UNITS  . 

GO  TRY. AGAIN 
REGARDLESS 

IF  FAMILY  (NODE)  IS  NOT  EQUAL  TO  SAME. FAMILY. 

-HAVE  ONLY  ONE  NODE  PER  FAMILY  BE  THE  GENERATOR  OF 
FAMILY  WARNING  MESSAGES. 

SCHEOULE  A  Ul. GENERATE. UPDATE  GIVEN  NODE.  FAH.MSG  IN 
FF.TIME  UNITS 

LET  SAHE.FAHIL'Y  -  FAMILY  (NODE) 

REGARDLESS 
"TRY. AGAIN’ 


LOOP 
«  « 

”  PACKET  MESSAGES  ARE  GENERATED  USING  AN  EXPONENTIAL  INTERARRIVAL 

”  RATE. 

«  » 

SCHEOULE  A  Ml. GENERATE. MESSAGE  GIVEN  REGULAR  IN 
EXPONENTIAL. F (MSG. GENERATION. INTERVAL. 8)  UNITS 

«  « 

”  DATA  IS  COLLECTED  AT  REGULAR  TIME  INTERVALS. 

«  I 

SCHEDULE  A  E2. COLLECT. DATA  IN  (TIME. LIMIT/REAL. F (SAMPLESJ I  UNITS 
•  « 

”  REPORT 'OATA  SUMMARIES  MAT  BE  REQUESTED  AT  THE  USER'S  OESCRETION. 

I  « 

SCHEOULE  A  EM. NETWORK. PERFORMANCE. REPORT  IN 

(nMEJ.IMIT/REAL.F(NUM. REPORTS. REQUESTED))  UNITS 

«  « 

"  LINK  HEIGHTS  ARE  CALCULATED  AT  REGULAR  TIME  INTERVALS. 

I  • 

SCHEOULE  A  US.LINK.WEIGHT.CALCULATION  IN  HT.'TIME  UNITS 
«  • 

”  THETRANSIENT'EFFECT  OF  THE  NETWORK  IS  ELIMINATED  AFTER  !0  SECONDS. 

I  I 

SCHEDULE  A  El. TRANSIENT. BLANKING  IN  NUL.TRANSIENT  UNITS 

I  I 

RETURN 

END  ’"OF  P570TNAMIC. EVENTS 


265 


ROUTINE  FOR  P6. PURGE. EVENT. QUEUE 


••  THE  FOLLOWING  SUBROUTINE  CANCELS  ANO/OR  DESTROYS  ALL  ENTITIES 
••  AND  EVENTS  Uhl  CM  REMAIN  IN  THE  TIMING  ROUTINE  AFTER 

••  T1ME.V  -  TIME. LIMIT.  SINCE  THIS  ACTION  EMPTIES  THE 

••  TIMING  ROUTINE.  CONTROL  OF  THE  PROGRAM  IS  RETURNED  TO  THE 

••  STATEMENT  FOLLOWING  ’START  SIMULATION*  IN  TME  '’MAIN* 

”  PROGRAM. 

«  » 

DEFINE  ITEM!.  1TEM2,  ITEMS  AS  VARIABLES 
«  « 

”  PRINT  1  LINE  WITH  T1ME.V  AS  FOLLOWS 

'*  - . .  DESTRUCTION  RUN  AT  mmm.mmmmm**  SECONOS  . . 


FOR  EACH  U6.N00E.WAKE.UP  IN  EV.S tl.UB. NODE. HAKE. UPI  ,  00 
CANCEL  TME  U6.N00E. WAKE. UP 
DESTROT  TME  U6. NODE . HAKE . UP 
LOOP 

FOR  EACH  U8. ERASE. RECORO  IN  EV.S  (I. U8. ERASE. RECORD) ,  DO 
CANCEL  TME  UB. ERASE. RECORO 
DESTROY  TME  U8. ERASE. RECORO 
LOOP 

FCR  EACH  Ul. GENERATE. UPOATE  IN  EV.S  (l.UI. GENERATE. UPDATE) .  DO 
CANCEL  TME  UI . GENERATE. UPOATE 
DESTROY  TME  UI. GENERATE. UPDATE 
LOOP 

FOR  EACM  U7. UNIT. FIRING  IN  EV. S  II . U7. UNIT. FIRING) ,  DO 
CANCEL  THE  U7. UNIT. FIRING 
DESTROT  TME  U7. UNI T. FIRING 
LOOP 

FOR  EACM  UA. RECEIVE. UPOATE  IN  EV. S  II .UA. RECEIVE. UPOATE) .  00 
CANCEL  THE  UA. RECEIVE. UPDATE 
OESTROY  TME  UA. RECEIVE. UPOATE- 
LOOP 

FOR  EACM  M2.RECE1VE. MESSAGE. PACKET  IN 
EV.SII. M2. RECEIVE. MESSAGE. PACKET)  .  DO 
CANCEL  TME  M2. RECEIVE. MESSAGE. PACKET 
OESTROT  TME  M2. RECE I VE . MESSAGE . PACKET 
LOOP 

FOR  EACH  Ml. GENERATE. MESSAGE  IN  EV. S  (I . Ml . GENERATE. MESSAGE) .  DO 
CANCEL TME  Ml . GENERATE . MESSAGE 
OESTROT  TME  Ml . GENERATE. MESSAGE 
LOOP 

FOR  EACM  EA. NETWORK. PERFORMANCE. REPORT  IN 
EV.S  (I.EA. NETWORK. PERFORMANCE. REPORT)  ,  00 
CANCEL  THE  EA. NETWORK. PERFORMANCE. REPORT 
DESTROT TME  EA. NETWORK. PERFORMANCE. REPORT 
LOOP 

FOR  EACM  E2.CQLLECTV0ATA  IN  EV.S  (I. E2. COLLECT .ORTA) .  00 


CANCEL  THE  E2. COLLECT. DATA 
DESTROY  THE  E2. COLLECT. DATA 

LOOP 

FOR  EACH  US. LINK. HEIGHT. CALCULATION  IN 
EV. 3(1. US. LINK. HEIGHT. CALCULATION! .  DO 
CANCEL  THE  US. LINK. HEIGHT. CALCULATION 
DESTROY  THE  US. LINK. HEIGHT. CALCULATION 

LOOP 

FOR  EACH  El. TRANSIENT. BLANKING  IN  EV. StI.El. TRANSIENT. BLANKING) .  DO 
CANCEL  THE  El .TRANSIENT. BLANKING 
OESTROT  THE  El. transient. blanking 

LOOP 

«  t 

RETURN 

END  "OF  P6. PURGE. EVENT. QUEUE 


ROUTINE  FOR  P7 ."ZEROIZE . SETS 
«  « 

"  THIS  ROUTINE  CLEARS  ALL  SETS  OF  THEIR  MEMBERS  AND  ZEROIZES  THE 

••  TIMING  routine  for  the  simulation  hhich  allohs  for  multiple  runs. 
«  • 

DEFINE  1TEM1 ,  1TEM2.  1TEM3,  1,  J  AS  VARIABLES 

»  t 

LET  TIME. V  .  0.0 

#  » 

FOR  EVERY  NODE.  00 
•  » 

FOR  EACH  ITEMI  IN  VIRT. CKT. LIST  (N0DE1 .  DO 
REMOVE  ITEMI  FROM  VIRT. CKT. LIST (NODE) 

DESTROY  CIRCUIT  CALLED  ITEMI 

LOOP 

FOR  EACH  ITEMI  IN  XMT. RECORD  (NODE)  ,  DO 
•  REMOVE  'ITEMI  FROM  XMT.  RECORD  (NODE) 

DESTROY  RECORD  CALLED  ITEMI 

LOOP 

FOR  EACH  ITEMI  IN  ALARM. CLOCK (NODE) ,  DO 
REMOVE  TTEM1  FROM  ALARM. CLOCK  (NODE) 

FOR  EACH  1TEM2  IN  BUZ. LIST (ITEMI) .  DO 
REMOVE  ITEM2  FROM  BUZ. LIST  (ITEMI) 

DESTROY  BUZ. NODE  CALLED  1TEM2 

LOOP 

DESTROY  BUZZER  CALLED  ITEMI 

LOOP 

FOR  EACH  ITEMI  IN  LINK. SET  (NODE) .  DO 

FOR  EACH  1TEM2  IN  QUEUE  (ITEMI) .  DO 
REMOVE  ITEM2  FROM  QUEUE  (ITEMI) 

RESET  THE  TOTALS  OF  LIFETIME  (ITEM2)  AND  OSTAT  (1TEM2) 
DESTROY  PACKET  CALLED  ITEM2 


FOR  EACH  ITEN2  IN  UQUEUE  ( I TEH 1 1 ,  00 
REHOVE  ITEH2  FROM  UQUEUE  (ITEHU 
DESTROY  UPDATE  CALLED  ITEM2 

LOOP 

LET  STATUS  (ITEH1!  «  IDLE 
LET  UPCOUNT  (ITEH1J  »  NONE 
LET  PTCOUNT  (ITEM1J  »  NONE 

RESET  THE  TOTALS  OF  STATUS  (ITEH1J  .  N. QUEUE  (ITEM1)  . 

N. UPROP. QUEUE  (ITEMIJ ,  N. UQUEUE  (ITEM1J  .  N. PROP. QUEUE  ilTEHl) 
FOR  EACH  ITEM2  IN  PROP. QUEUE  (ITEMIJ .  DO 
REMOVE  ITEM2  FROM  PROP. QUEUE  (ITEMIJ 
RESET  THE  TOTALS  OF  LIFETIME  (ITEM2J  AND  QSTAT  (ITEM2) 
DESTROY  PACKET  CALLED  ITEM2 

LOOP 

FOR  EACH  ITEM2  IN  UPROP. QUEUE  (ITEMIJ .  DO 
REMOVE  ITEM2  FROM  UPROP. QUEUE  (ITEMIJ 
DESTROY  UPDATE  CALLED  ITEM2 

LOOP 

FOR  EACH  I7EH2  IN  SET.'OF.HEIGHTSJITEHU  ,  DO 
REMOVE  ITEM2  FROM  SET. OF. HEIGHTS  (ITEMIJ 
DESTROY  HEIGHT  CALLED  ITEM2 

LOOP 

RESET  "THE  TOTALS  OF  QUESI2  (ITEMIJ 

LOOP 

LOOP 

•  1 

FOR  I  -  1  70  N.NODE,  DO 

FOR  J  •  1  TO  N.NODE.  DO 

LET  BORN.PKTS  (I .  JJ  *  0 
LET  GONE.PKTS  (I.  JJ  »  0 
LET  JUMP  .'TOTAL  (I,  JJ  -  0 
LET  LENGTH. TRIP  (I,  JJ  -  0.0 

LOOP 


LOOP 

LET 

COMP  .TRIP. PKT 

-  0 

LET 

NEH.MSG.TOTAL 

-  0 

LET 

NEH.PKT.TOTAL 

-  0 

LET 

STS. PACKETS 

■  0 

LET 

U, COUNT 

-  0 

reset  the-totals  OF 

STS. PACKETS 

LET 

MOP. TOTAL 

-  0 

LET 

XMT7T0TAL 

-  O.D 

LET 

t  t 

QU. TOTAL 

■  0.0 

”  RESET_THE  STARTING  VALUES  FOR  THE  RANOOM  NUMBER  GENERATOR. 

LET  SEED.  V  (1)  >  2116V29302 

LET  SEED. V (2J  ■  68374381V 

LET  SEED.  V  (31  ■  96V 39317V 

LET  SEED.  V  (VJ  ■  1217V26631 

LET  SEED.  V  (5J  -  618V33579 


LET  SEED.  V  (6)  -  1157240309 

LET  SEE0.V17)  ■  15726055 

LET  SEED.  V  (8)  -  48108509 

LET  SEED.  V  (9)  «  1797920909 

LET  SEED.  V  (10)  ■  477424540 

RETURN 

END  ,,0F  P7. ZEROIZE. SETS 


EVENT  Ul. GENERATE. UPOATE  GIVEN  SENDING. NODE.  UP. CLASS 
•  • 

•*  IN  THIS  EVENT,  THE  DESTINATION  NODE  GENERATES  ONE  OF  THREE 
••  TTPES  OF  UPDATE  MESSAGESt  NODE.  GROUP  WARNING.  OR  FAMILY 
••  WARNING.  THE  NOOE  THEN  TRANSMITS  THIS  UPDATE  TO  EACH 
••  OF  ITS  NEIGHBORS  AT  THE  SAME  TIME  IF  ALL  LINKS  ARE  IDLE. 

••  IN  THE  CASE  OF  BUST  LINKS,  THE  UPDATE  MESSAGES  ARE  INSERTED 
••  OR  QUEUED  ACCORDING  TO  THE  TYPE  OF  TRAFFIC  ON  THE  LINE. 

DEFINE  THIS. NOOE.  THE. CLASS  AS  VARIABLE 
DEFINE  NEW. INC.  VARY. TIME  AS  A  REAL  VARIABLE 
LET  THIS. NODE  -  SENDING. NODE 

LET  THE. CLASS  -  UP. CLASS 
•  • 

’•  BRANCH  TO  THE  APPROPRIATE  SECTION  DEPENDING  UPON  THE  CLASS  OF 
••  UPDATE  REQUESTED  (NOOE,  GROUP,  OR  FAMILY). 

t  « 

GOTO  NOD. REQUESTED.  GRP. REQUESTED,  FAM. REQUESTED 
PER  THE. CLASS 

•  • 

•  • 

•  ••••»•*»«»»• 

•NOO. REQUESTED* 

•  • 

••  SEND  A  NODE  UPDATE  TO  ALL  NEIGHBOR  NODES. 

*  * 

IF  PRNT  >«  3. 

SKIP  1  LINE 

PRINT  2  LINES  WITH  TIME.V.  THIS. NODE  AS  FOLLOWS 
mmm.mmmm  (mm)  «  NOOE  UPDATE  ORIGINATED. 

SENTTO  THE 'FOLLOWING  NODES* 

REGAROLESS 

*  t 

FOR 'EACH  LINK  IN  LINK.  SET  (THI S.  NODE)  ,  DO 

*  « 

IF  PRNT  >«  3. 

PRINT  1  LINE  WITH  TERM  (LINK)  AS  FOLLOWS 

MM 

REGAROLESS 
CREATE  AN  UPDATE 

LET  8EGIN. TIME  (UPDATE)  ■  TIME.V 
LET  CLASS  (UPDATE1  ■  THE. CLASS 


LET  ORIGIN  (UPDATE)  ■  THIS. NODE 

LET  FM.  NODE  (UPDATE)  ■  THIS. NODE 

LET  VARIETY  (UPOATE)  »  REGULAR 

LET  HOPCNT (UPOATE)  ■  NONE 

LET  TO. NODE  (UPOATE)  *  TERH  (LINK) 

*  * 

PERFORM  U2. TRANSMIT. UPOATE  GIVEN  UPDATE.  LINK 

*  « 

LOOP 

I  « 

••  RESCHEDULE  ANOTHER  UPOATE  FOR  THIS  NODE  AT  A  LATER  TIME 
••  UNLESS  THIS  IS  THE  INITIALIZATION  PHASE  FOR  DETERMINING 

••  THE  BEST  PATHS  BETWEEN  NODES. 

«  « 

IF  I  NIT. BP  -  DEAD. 

LET  NEH.INC  -  UNIFORM. F (NOD.T1ME, NOD. TIME  ♦  BRACKET. 3) 

IF  DISCRETE. TIMER  -  ALIVE. 

LET  NEH.INC  -  (TRUNC.F  (NEW.  INC/BIT.  INTERVAL)  »  BIT. INTERVAL) 
■»  U.  XMN.  TIME 

REGARDLESS 

SCHEDULE  A  Ul. GENERATE. UPDATE  GIVEN  THIS. NODE.  THE. CLASS 
IN  NEH.INC  UNITS 

REGAROLESS 
«  « 

GO  FILE.THE. UPOATE 


'GRP. REQUESTED* 

«  « 

**  A  GROUP  WARNING  MSG  HILL  BE  SENT  TO  ALL. NODES  IN  THE  SAME  GROUP 
**  AS  THE  ORIGINATOR.  THIS  WARNING  MSG  HILL  INCLUDE  A  FUTURE  TIME 
**  (FIRING. TIME)  WHEN  ALL  NODES  WITHIN  THE  GROUP  HILL  SEND  THE  GROUP 
*•  UPDATE  MESSAGE  AT  THE  SAME  TIME. 

*  *  t 

**  SCHEDULE "THIS  N0DE~TO  "TRANSMIT  ITS  OWN  REGULAR  GROUP  UPDATE 
**  AT  THE  COMPUTED  FIRING  TIME.  THIS  MESSAGE  IS  SENT  ONLY  TO 

”  NEIGHBOR  NODES  WHICH  ARE  NOT  IN  THE  SAME  GROUP  AS  THIS  NODE. 

«  • 

IF  PRNT  >-  3. 

SKIP  I  LINE 

PRINT  3  LINES  WITH  TIME.  V.  THIS. NODE.  GROUP  (THIS. NODE) . 

TIME. V  ♦  GP.FTRE  AS  FOLLOWS 
mmm.mmmm  (««)  i  GROUP  UPDATE  WARNING  ORIGINATED. 

GROUP  (*«)  SET  “TO  XMT  UPDATE  AT  «««.««««. 

WARNING  SENT 'TO  THE  FOLLOWING  NODESi 

REGARDLESS 
«  • 

SCHEDULE  A  U7. UNIT. FIRING  GIVEN  THIS. NODE.  THE. CLASS.  GROUP (THIS. NODE) 
TIME. V  AT'TIMC.V  ♦  GP. FIRE 


V  '/  .■  V  v  V 


v;.v  vv, 


F8R  EACH  LINK  IN  LINK. SET  (THIS. NODE)  WITH  GROUP  (THIS. NODE)  - 
GROUP  (TERM  (LINK))  .  DO 

«  « 

IF  PANT  >«  3. 

PRINT  I  LINE  WITH  TERM  (LINK)  RS  FOLLOWS 

MM 

REGARDLESS 
CREATE  AN  UPDATE 

LET  BEGIN. TIME  (UPDATE)  •  TIME.V 

LET  CLASS  (UPDATE)  -  THE. CLASS 

LET  ORIGIN  (UPDATE)  -  GROUP  (THIS. NODE) 

LET  FM. NODE  (UPDATE)  -  THIS. NODE 

LET  VARIETY  (UPDATE)  -  WARNING 

LET  HOPCNT  (UPDATE)  -  NONE 

LET  TO.  NODE  (UPDATE)  -TERM  (LINK) 

LET  FIRING. TIME  (UPDATE)  •  TIME.V  ♦  GP.FIRE 
IF  DISCRETE. TIMER  •  ALIVE. 

LET  FIRING. TIME (UPDATE)  ■ 

(TRUNC.F  (FIRING. TIME  (UPDATE) /BIT. INTERVAL)  «  BIT. INTERVAL) 
♦  U.XMN.T1ME 

REGARDLESS 

«  « 

PERFORM  U2. TRANSMIT. UPDATE  GIVEN  UPDATE.  LINK 


RESCHEDULE  ANOTHER  GROUP  UPDATE  FOR  THIS  NODE  AT  A  FUTURE  TIME 


IF  1NIT.BP  «  DEAD, 


LET  NEW. INC  -  UNIFORM. F  (GRP. TIME. GRP.TIME  ♦  BRACKET, 5) 

IF  DISCRETE. TIMER  -  ALIVE. 

LET  NEW. INC  -  (TRUNC. F  (NEW. INC/BIT. INTERVAL)  *  BIT. INTERVAL) 
♦  U.  XMN. TIME 

REGARDLESS 

SCHEDULE  A  U1 . GENERATE. UPDATE  GIVEN  THIS. NODE.  THE. CLASS 
IN  NEW. INC  UNITS 

REGARDLESS 
*  « 

GO  FILE. THE. UPDATE 


FAM. REQUESTED* 

« 

*  A  SIMILAR  OPERATION  IS  PERFORMED  FOR  THE  FAMILY  AS  WAS  DONE  WITH 

*  THE  PREVIOUS  SECTION  CONCERNING  THE  GROUP  WARNING. 


*  SCHEDULE- 'THIS  NODE  TO  TRANSMIT  ITS  OWN  REGULAR  FAMILY  UPDATE 


,  •*,  •  «\  \  i\  >",  •  .  • .\r\  V,  **V 


>v 


'.v.'W . -J 


r->  .’ 
svy 
r- v.v 


l*  ■/•. 
:>:•:■ 
I  /  */  - 


••  AT  THE  COMPUTEO  FIRING  TlHE.  THIS  MESSAGE  IS  SENT  QNLT  TO 

**  NEIGHBOR  NODES  WHICH  RRE  NOT  IN  THE  SAME  FAHlLT  AS  THIS  NODE. 

«  * 

IF  PRNT  >-  3, 

SKIP  1  LINE 

PRINT  3  LINES  WITH  TlNE.V.  THIS. NODE.  FAHILT (THIS. NODE) . 

TIME.V  *  FM.FIRE  AS  FOLLOWS 
kxm.kkkk  (hh)  >  FAHlLT  UPDATE  WARNING  ORIGINATED. 

FAHlLT  (xx)  SET  TO  XHT  UPDATE  AT  xx*.x*xx. 

WARNING  SENT  TO  THE  FOLLOWING  NODESi 

REGARDLESS 
«  % 

SCHEDULE  A  U7.UN1T. FIRING  GIVEN  THIS. NODE.  THE. CLASS. FAHILT (THIS. NODE) , 
TlHE. V  AT  TlHE. V  ♦  FM.FIRE 


FOR  EACH  LINK  IN  L INK.  SET  (THIS. NODE)  WITH  FAHILT  (THIS. NODE) 
FAHILT  (TERM  (LINK) )  .  DO 


IF  PRNT  >-  3. 

PRINT  1  LINE  WITH  TERM  (LINK)  AS  FOLLOWS 


REGARDLESS 
CREATE  AN  UPDATE 

LET  BEGIN. TIME (UPDATE)  -TIME.V 

LET  CLASS  (UPOATE)  •  THE. CLASS 

LET  ORIGIN  (UPDATE)  -  FAHILT  (THK5. NODE) 

LET  FH.NOOE  (UPOATE)  •  THIS. NODE 

LET  VARIETT (UPDATE)  -  WARNING 

LET  HOPCNT (UPOATE)  »  NONE 

LET  TO. NOOE  (UPDATE!  -  TERM  (LINK) 

LET  FIRING. TIME  (UPDATE)  -  TIHE.V  ♦  FM.FIRE 
IF  OISCRETE.TIMER  ■  ALIVE. 

LET  FIRInGTIHE  (UPDATE)  - 

(TRUNC.F  (FIRING. TIME  (UPDATE) /BIT.  INTERVAL)  x  BIT.  INTERVAL) 

♦  u.xhn.time 

REGARDLESS 


PERFORM  U2.TRANSMIT. UPOATE  GIVEN  UPDATE.  LINK 


*•  RESCHEDULE.  A  FAHILT  UPDATE  FOR  THIS  NODE  AT  A  FUTURETIME. 

*  « 

IF  1NIT.BP  -  DEAD. 

«  « 

LET  NEW. INC  -  UNIFORM. F (FAH. TIME. FAN. TIME  ♦  BRACKET. 8) 

IF  DISCRETE. TIMER  -  ALIVE. 

let  new. inc  -  (Trunc.f  (new.  inc/bit. interval)  *  bit.  interval) 
♦  u.xhn.time 

REGAROLESS 
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SCHEOULE  A  Ul. GENERATE. UPDATE  GIVEN  THIS. NODE,  THE. CLASS 
IN  NEW. INC  UNITS 

REGARDLESS 
«  • 

•  • 

•  •  •  •  •••••••• 

’FILE. THE. UPOATE  * 

«  « 

LET  U. COUNT  -  U. COUNT  *  I 
«  « 

IF  PRNT  >-  3. 

PRINT  1  LINE  WITH  U. COUNT  AS  FOLLOWS 

*****  UPDATES  GENERATED  SO  FAR. 

REGARDLESS 
«  « 

RETURN 
«  « 

END  ’ ’OF  Ul. GENERATE. UPDATE 


ROUTINE  FOR  U2.TRANSHI T. UPDATE  GIVEN  X. UPDATE.  X.LINK 

”  THIS  ROUTINE  PERFORMS  THE  ROLE  OF  TRANSMISSION  OF 'THE  UPDATE 
”  OVER  THE  SELECTED  LINK.  DEPENDING  UPON  THE  STATUS  OF  THE  LINK 
”  HOLE  OR  BUST)  ANO  THE  TYPE  OF  TRAFFIC  WHICH  THE  LINK  IS 

”  CURRENTLY  TRANSMITTING.  DIFFERENT  ACTION  IS  TAKEN. 

«  « 

IF  STATUS (X.LINK)  --IOLE. 

«  « 

”  THE  UPDATE  MAY  BE  SENT. 

SCHEOULE  AN  UN. RECEIVE. UPDATE  GIVEN  X. UPDATE  IN  U.XMN.TIME  UNITS 

LET  STATUS  (X.LINK)  ■  BUSY 

FILE  X. UPDATE  IN  UPROP. QUEUE  (X.LINK) 


THE  LINK  IS  BUSY  UNDER  ONE  OF  THREE  CONDITIONS* 

(1)  REGULAR  MESSAGE  PACKET 'TRAFFIC  IS  BEING 'TRANSMITTED  WITH 
NO  ’INSERTED’  UPDATES  CURRENTLY  IN  TRANSIT. 

(2)  UPOATE  'TRAFFIC  IS  IN  TRANSIT  WHICH  HAS  NOT  BEEN  ’INSERTED’ 
INTO  A  REGULAR  MESSAGE  PACKET  OATA  STREAM. 

(3)  ’INSERTED’  UPDATE  TRAFFIC  IS  CURRENTLY  IN  TRANSIT  WITHIN 
A  RUGULAR -MESSAGE  PACKET’S  OATA  STREAM. 

CONDITION  (I) 

IF  UPROP.OUEUE  (X.LINK)  IS  EMPTY. 

SCHEOULE  AN  UN. RECEIVE. UPOATE  GIVEN  X. UPOATE  IN  U.XMN.TIME  UNITS 
FILE  X. UPDATE  IN  UPROP. QUEUE (X.L INK) 

PERFORM  U3. INSERT. UPOATE  GIVEN  X.LINK 
RETURN 
REGAROLESS 


•  « 


CONDITION  (2) 


IF  PROP. QUEUE  (X. LINK)  IS  EMPTY, 

FILE  X. UPDATE  IN  UQUEUE CX.L1NK) 
RETURN 
REGARDLESS 

«  «  t 

'•  CONDITION  (3) 

t  t 

FILE  X.UPOATE  IN  UQUEUE  (X. LINK) 
PERFORM  U3. INSERT. UPDATE  GIVEN  X.LlNK 
REGARDLESS 
RETURN 

END  ’’OF  U2.TRANSM IT. UPDATE 


ROUTINE  FOR  U3. INSERT. UPDATE  GIVEN  ID. LINK 

9  « 

”  THIS  ROUTINE  MODIFIES  THE  ARRIVAL  TIME  OF  A  MESSAGE  PACKET 
”  CAUSED  WHEN  AN  UPDATE  IS  INSERTED  INTO  IT*S  BIT  STREAM. 

%  9 

DEFINE  PKT.  THE. NAME  AS  VARIABLES 
•  « 

REMOVE  FIRST  PKT  FROM  PROP. QUEUE  (ID. LINK) 

t  • 

”  THE  EVENT  OF  THE  ARRIVAL  OF  THE  PACKET  IS  NON  DELATED  BY  THE 
”  AMOUNT  OF  TIME  IT  TAKES  FOR  AN  UPDATE  TO  BE  TRANSMITTED. 

I  « 

CANCEL  M2. RECEIVE. MESSAGE. PACKET  CALLED  P. NAME  (PKT) 

OESTROT  M2. RECEIVE. MESSAGE. PACKET  CALLED  P. NAME  (PKTI 

9  9 

RESCHEDULE  A  M2.RECEIVE. MESSAGE. PACKET  CALLED  THE. NAME  GIVEN  PKT  AT 
P. ARRIVAL  (PKTI  ♦  U.XMN.TIME 

9  • 

LET  P. ARRIVAL  (PKT)  ■  P. ARR1 VAL  (PKT)  ■*  U.XMN.TIME 
LET  P. NAME  (PKT)  ■  THE. NAME 

9  9 

FILE  PKT  IN  PROP. QUEUE  (ID.LINK) 

RETURN 

END  ’  ’OF  U3. INSERT. UPDATE 


EVENT  UN. RECEIVE. UPDATE  GIVEN  UP. MESSAGE 
•  » 

”  THIS 'EVENT "PERFORMS  THE  PRIMARY  function  of  the  yen  ALGORITHM. 
”  WHEN  THE  UPDATE  ARRIVES  THE  CALCULATIONS  OF  THE  ALGORITHM  TAKE 
”  PLACE  WITH  THE  APPROPRIATE  SCHEDULING  OF  THE  FUTURE  UPDATE 
”  TRANSMISSION  OCCURRING. 


■  'f 
%  *  • 


m 

i  -  *  • 


* 


\  v 

•  mj 


►ft 


•v? 


J 

i 

/ 

* 

* 


V 

*  rj 


H; 


a? 


DEFINE  NSC.  THIS. NODE.  PAST. NODE,  KIND,  OCCURANCE.  THE. HAKE. 

HO.PCOUNT,  THE. LINK.  THE. BUZZ. U.HSG.  Q. UP. MSG.  PAC.KET.  THE. NAME 
AS  INTEGER  VARIABLES 

DEFINE  DELAY. TIME.  THIS. LINK. HEIGHT  AS  REAL  VARIABLES 

t  • 

LET  MSG  -  UP. MESSAGE 

LET  KINO  •  VARIETY  (MSGI 

LET  THIS. NODE  -  TO. NODE  (MSG) 

LET  PAST. NODE  ■  FH.NODE (MSG) 

LET  HO.PCOUNT  -  HOPCNT  (MSG)  *  1 


THE  UPDATE  HAS  BEEN  TRAVELING  DOHN'THE  LINK  AND  IS  KEPT  TRACK  OF  BY 

,;eans  of  a  uprop. queue,  the  update  has  ARRIVED  AND  CAN  non  be 

REMOVEO  FROM  THAT  QUEUE. 

EACH  LINK  CONTAINS  A  COUNT  OF  THE  NUMBER  OF  UPDATE  MESSAGES  HHICH 
HAVE  TRAVELEO  OVER  IT.  IN  THIS  HAT,  HE  CAN  SEE  THE  PROPORTION  OF 
TOTAL  TRAFFIC  OVER  EACH  LINK  HHICH  IS  RELATED  TO  ROUTING  INFO. 


FOR  EACH  LINK  IN  LINK. SET  (PAST. NODE)  HITH  TERM  (LINK)  -  THIS. NODE, 
FIND  THE. LINK  -  LINK. 

IF  FOUND. 

REMOVE  THE  FIRST  U.MSG  FROM  UPROP. QUEUE (THE. LINK) 

LET  UPCOUNT (THE. LINK)  -  UPCOUNT  (THE. LINK)  ♦  1 
REGARDLESS 


EVERY  NODE  MAINTAINS  A  RECORD  OF  UPDATE  RETRANSMISSIONS  HHICH 
IT  HAS  PROOUCED.  IF  THE  NODE  HAS  PREVIOUSLY  SENT  A  RETRANS  OF 
THIS  CURRENT  UPOATE  THEN  THE  UPDATE  IS  IGNORED  AND  NO  ACTION  TAKEN. 


FOR  EACH  RECORD  IN  XMT. RECORD  (THIS. NODE)  HITH  ORIGIN  (HSG)  - 
REC. ORIGIN (RECORD)  AND  BEGIN. TIME (MSG)  -  REC. TIME  (RECORD) . 

FIND  THE  FIRST  CASE. 

IF  FOUNO. 

•  • 

IF  PANT  >•  3. 

SKIP  1  LINE 

PRINT  1  LINE  HITH  TlME.V.  THIS. NODE.  ORIGIN  (MSG)  .BEGIN. TIME  (MSG)  . 
PAST. NODE  AS  FOLLOHS 

RMR.MMHM  (rr)  I  *LATE  *  UPDATE  (RR . RRR .  KRRR)  FROM  NODE  «n. 

REGARDLESS 

*  % 

DESTROY  UPDATE  CALLED  U.MSG 
GO  CHECK. THE. QUEUES 

AEGAROLESS 
» « 

’•  DETERMINE  HMETHER  REGULAR  OR  WARNING  UPDATE  AND  TAKE  THE 
*•  THE  APPROPRIATE  ACTION. 

I  % 

GO  TO  REG. MSG.  WARN. MSG  PER  KIND 


BEG. MSG 


t  « 

”  DETERMINE  WHETHER  NODE.  GROUP  OR  FAMILT  RND  TAKE  RPPROPR1RTE  RCTION 
•  « 

GO  TO  NOD. REQUESTED.  GRP. REQUESTED.  FAM. REQUESTED  PER  CLASS (MSG) 

«  • 

«  « 

•NOD. REQUESTED* 

•  • 

”  HE  MUST  DETERMINE  IF  THIS  NODE  UPDATE  MSG  ORIGINATED  FROM  A  NODE 
**  IN  THIS  NODE’S  GROUP.  IF  NOT.  A  BORDER  CHECK  IS  RUN.  IF  THE 

*’  BOROER  CHECK  PROVES  NEGATIVE.  NO  ACTION  IS  TAKEN. 

«  « 

IF  FAMILT  (THIS. NODE)  -  FAMILT  (ORIGIN  (MSGI)  AND 
GROUP  (THIS.  NODE)  -  GROUP  (ORIGIN  (MSG)  I  . 

«  « 

GO  CALC. THE. OELAT 

REGARDLESS 
•  % 

**  RUN  A  BORDER  CHECK 
•  • 

IF  HO.PCOUNT  <«  HOP. LIMIT, 

IF  PRNT  *•  3. 

PRINT  1  LINE  AS  FOLLOWS 

•••••  NODE  BORDER  INCIDENT  ••••a 

REGAROLESS 

«  « 

GO  CALC. THE. OELAT 
REGARDLESS 
IF  PRNT  »•  3. 

SKIP  l  LINE 

PRINT  1  LINE  HITH  TIME.V.  THIS.NOOE.  ORIGIN(HSG).  BEGIN. TIME  (MSG) 

AS  FOLLOWS 

.  ("«)  i  NflOE  UPOATE  (««,«««. wkmm)  ARRIVED.  •■NOT  IN  RANGE** 

REGAROLESS 

OESTROT  UPOATE.  CALLEO  U.MSG 

GO  CHECK. THE. QUEUES 
•  « 


«  «  * 

•  ••••••••••••a 

’GRP. REQUESTED’ 

•  « 

”  IF  THE  GROUP  UPOATE  IS  FROM  A  NOOE  WITHIN  THIS  NOOE’S  GROUP 

”  THEN  NO  ACTION  IS  TAKEN. 

«  « 

IF  GROUP  (THIS.NOOE)  •  ORIGIN  (MSG), 

DESTROT  UPOATE  CALLED  U.MSG 
GO  CHECK. THE. QUEUES 
REGAROLESS 


**  IF  THE  GROUP  UPOATE  IS  FROM  ft  NODE  FROM  ft  DIFFERENT  FAMILT 
••  THEN  ft  BORDER  CHECK  IS  PERFORMED.  IF  BORDER  CHECX  IS  NEGATIVE 

”  THEN  NO  ACTION  IS  TAKEN. 

•  • 

IF  FAMILT  (THIS.  NODE)  -  FftH.  OF. GRP  (ORIGIN  (MSG) )  . 

GO  CflLC. THE. DELAY 

REGARDLESS 
•  • 

"  PERFORM  BORDER  CHECK 
•  * 

IF  HO.PCOUNT  <-  HOP. LIMIT. 

IF  PRNT  >«  3. 

PRINT  1  LINE  AS  FOLLOWS 

•••••  GROUP  BORDER  INCIDENT  «•••• 

REGARDLESS 

%  % 

GO  CALC. THE. DELAT 
REGARDLESS 
IF  PRNT  >«  3. 

SKIP  1  LINE 

PRINT  1  LINE  WITH  T1ME.V.  THIS. NODE.  ORIGIN  (MSG).  BEGIN. TIME  (MSG) 

AS  FOLLOWS 

mmm.mmmm  (m)  i  GROUP  UPDATE  l", *** . -««-)  RECEIVED.  --NOT  IN  RANGE-- 
REGAROLESS 

DESTROY  UPOATE  CALLED  U.NSG 

GO  CHECK. THE. QUEUES 
•  • 

%  * 

'FAN. REQUESTED* 

%  • 

IF  FAMILY  (THIS. NODE)  -  ORIGIN  (MSG), 

IF  PRNT  >-  3, 

SKIP  I  LINE 

PRINT  1  LINE  WITH  TIME.V,  THIS. NODE.  ORIGIN  (MSG).  BEGIN.  TIME  (MSG) 
AS  FOLLOWS 

mm .  (")  i  FAMILY  UPOATE  ("."«. ««««)  RECEIVED.  —NOT  IN  RANGE" 

REGARDLESS 

DESTROY  UPDATE  CALLED  U.MSG  . 

GO  CHECK. THE. QUEUES  ' 

REGAROLESS 
•  « 

•  • 

•  •••••••••••a 

'CALC. THE. OELAT’ 

•  • 

"  THE  •WEIGHT'*  OF  A  LINK  IS  DETERMINED  BY  THE  EVENT 

"  *CALC. LINK. WEIGHT*  IN  WHICH  FIVE  METHODS  ARE  POSSIBLE. 

•  % 

LET  THIS. LINK. WEIGHT  -  0.0 

« . 

FOR  EACH  LINK  IN  LINK. SET  (THIS. NOOE)  WITH 


TERM  (LINK) -PAST. NOOE.  FIND  THE. LINK-  LINK. 

IF  FOUNO, 

•  • 

IF  TEST  -  ALIVE. 

LET  THIS. LINK. HEIGHT  •  REAL. F  (OTEST  (THE. LINK)) 

GO  CONT. TEST 
AEGAROLESS 

•  • 

IF  HANNER. OF. WEIGHTING  -  BY.QSIZE.NOH, 

LET  THIS. LINK. HEIGHT  -  REAL. F  (N. QUEUE  (THE. LINK) ) 

GO  CONT. TEST 
REGARDLESS 

•  * 

IF  HANNER. OF. WEIGHTING  -  BT. COHBINE. 

LET  THIS. LINK. HEIGHT  -  (QU. FACT  -  REAL. F  (N. QUEUE  (THE. LINK) ) ) 
♦  LK. HEIGHT  (THE. LINK) 

GO  CONT. TEST 
REGAROLESS 

•  • 

”  LINK  WEIGHTING  SCHEHES  USING  VARIOUS  HETHODS  ARE  DETERHINED 

••  USING  THE  EVENT  *CALC. THE. DELAY*. 

•  • 

LET  THIS. LINK. HEIGHT  -  LK. HEIGHT  (THE. LINK) 

*  * 

•CONT. TEST* 

•  • 

REGAROLESS 
*  • 

•’  OETERHINE  THE  OELAT  TIHE  ASSOCIATED  WITH  THAT  LINK. 

•  • 

LET  OELATjTIHE  -  TIHE.V  ♦  U.XHN.TIHE  ♦  (DELTA  *  THIS. LINK. HEIGHT) 

•  • 

'•  CHECK  IF  THIS  OELAT  IS  LESS  THAN  PREVIOUS  OELAT. 

••  THE  PREVIOUS  DELAYS  ARE  MAINTAINED  IN  THE  NOOE’S  ALARM  CLOCK  SET. 
•  • 

FOR  EACH  BUZZER  IN  ALARM. CLOCK  (THIS. NODE)  WITH  CAUSE  (BUZZER)  - 
ORIGIN  (MSG)  ANO  BUZ. BEG  (BUZZER)  -  BEGIN. TIME  (HSG)  , 

FINO  THE. BUZZ  •  BUZZER. 

IF  FOUNO, 

”  FILE  THE  ID  OF  THE  NOOE  FROM  WHICH  THIS  UPOATE  HAS  RECEIVEO 
*•  INTO  THE  LIST  HELD  BT  THE  NOOE. 

CREATE  A  BUZ. NOOE 

LET  ID.NUHBER(BUZ.NOOE)  -  PAST. NOOE 
FILE  BUZ. NODE  IN  BUZ. LI  ST  (THE. BUZZ) 

•  • 

”  CHECK  IF  THIS  NEH  OELAT  IS  FASTER  THEN  THE  PREVIOUS  BEST  DELAY. 

t  * 

IF  OELAT. TIME  <  SETTING (THE. 8UZZ) , 
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CANCEL  U6.NflOE.HAKE.UP  CALLED  BUZ.  HAKE  (THE.  BUZZ) 
DESTROY  U6.N00E.HAKE.UP  CALLED  BUZ. HAKE  (THE. BUZZ) 


•*  PUT  IN  NEH  FASTEST  ALARM  TIME 

•  • 

LET  SETTING  (THE. BUZZ)  -  OELAT.  TIME 
LET  TEMP. BP  (THE. BUZZ)  -  PAST. NODE 

•  • 

IF  PRNT  >-  3. 

SKIP  1  LINE 

PRINT  2  LINES  UITH  TIME.V,  THIS. NODE.  ORIGlN(MSG). 

BEGIN.  TIME  (MSG)  .  PAST.  NODE.  SETTING  (THE.  BUZZ) 

AS  FOLLOHS 

MK.mm  (MM)  I  ALARM  CLOCK  RESET  -  UPDATE  (mm. mmm.mmmm)  FROM  NODE  mm. 
NOW  SET  TO  GO  OFF  AT  mmn.mmmm. 

REGARDLESS 

•  • 

**  CHECK  TO  SEE  IF  HE  HAVE  ALREADY  RECEIVED 

•*  UPDATES  FROM  ALL  LINKS.  IF  THIS  BE  THE  CASE  THEN 

••  A  BEST  PATH  CAN  BE  DETERMINED  HITHOUT  HAVING  TO 

”  SEND  OUT  A  RETRANSMISSION  OF  THE  UPDATE. 

t  • 

IF  N.LINK. SET  (THIS. NODE)  •  N. BUZ. LIST (THE. BUZZ) , 

IF  BEST. PATH (THIS. NODE,  ORIGIN  (MSG))  NE  PAST. NODE. 

IF  PRNT  •). 

SKIP  I  LINE 

PRINT  2  LINES  HITH  TIME.V.  THIS. NODE. 

THIS. NODE.  ORIGIN (MSG).  PAST. NODE. 

BEST. PATH (THIS. NODE. ORIGIN (MSG) ) 

AS  FOLLOHS 

mmm.mmmm  (««]  i  NEH  BEST  PATH  -  NO  RETRANSMISSION  NEEDED. 

FROM  mm  TO  mm  IS  NOH  mm.  (HAS  mm) 

REGAROLESS 

REGARDLESS 

LET  BEST. PATH (THIS. NODE. ORIGIN (MSG))  -  PAST. NODE 

•  • 

IF  PRNT  >-  2. 

PRINT  2  LINES  HITH  THIS. NODE,  ORIGIN (MSG) .PAST. NODE 
AS  FOLLOHS 

••  RETRANSMISSION  OF  UPDATE  NOT  NEEDED  •• 

BEST  PATH  FROM  mm  TO  mm  IS  mm. 

REGAROLESS 

«  « 

**  DESTROY  ALL  BUZZER  INFORMATION  FROM  THE 

•*  ALARM  CLOCK  OF  THE  NODE. 

t  t 

FOR  EACH  OCCURANCE  OF  BuZ. LIST (THE. BUZZ) .  DO 
REMOVE  OCCURANCE  FROM  BUZ. LIST  (THE. BUZZ) 

DESTROY  BUZ. NODE  CALLED  OCCURANCE 

LOOP 
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REMOVE  THE. BUZZ  FROM  ALARM. CLOCK (THIS. NODE) 

DESTROY  BUZZER  CALLED  THE. BUZZ 

*  • 

DESTROT  UPOATE  CALLED  U.MSG 
GO  CHECK. THE. QUEUES 
REGARDLESS 

•  « 

'•  RESCHEDULE  THE  NEH  HAKE  UP  AT  THE  NEH  SHORTER  DELAT  TIME. 

•  % 

RESCHEDULE  A  U6. NODE. HAKE. UP  CALLED  THE. HAKE  GIVEN 
THIS. NODE.  MSG.  TEMP. BP  (THE. BUZZ) .  HO.PCOUNT 
AT  SETTING  (THE.  BUZZ) 

•  « 

LET  BUZ. HAKE  (THE. BUZZ)  -  THE. HAKE 

•  • 

GO  CHECK. THE. QUEUES 
REGARDLESS 

DESTROT  UPDATE  CALLED  U.MSG 
GO  CHECK. THE. QUEUES 

REGARDLESS 
«  « 

*•  THIS  CASE  CORRESPONDS  TO  THE  FIRST  TIME  THIS  NODE  MAS  RECEIVED 

”  AN  UPDATE  ORIGINATION  FROM  THAT  NODE. 

*  % 

CREATE  A  BUZZER 

LET  SETTING (BUZZER)  •  DELAY. TIME 
LET  CAUSE  (BUZZER)  -  ORIGIN  (MSG) 

LET  BUZ. BEG  (8UZZER)  -  BEGIN.  TIME  (MSG) 

LET  TEMP. BP  (BUZZER)  -  PAST. NODE 
«  « 

1 r  PRNT  >-  3, 

SKIP  1  LINE 

PRINT  2  LINES  MITH  TlME.V.  THIS. NODE.  ORIGIN(MSG),  BEGI N. TIME  (MSG) . 

PAST. NODE.  SETTING (BUZZER)  AS  FOLLOHS 
mmh.kmmm  (mm)  i  ••NEH  ALARM  CLOCK** —  UPDATE  (x*,***.****)  FROM  NODE  *« 
SETTING  TO  GO  OFF  AT  . . mm. 

REGARDLESS 
•  * 

CREATE  A  BUZ. NODE 

LET  ID. NUMBER  (BUZ. NODE)  -  PAST. NODE 
•  • 

**  SET  THE  ALARM  FOR  THIS  UPDATE  TO  GO  OFF  AFTER  THE  OELAT  TIME  IS 
*•  UP.  THIS  IS  CONDITIONED  ON  THE  BASIS  THAT  A  SHORTER  DELAT  BT 
”  ANOTHER  PATH  IS  NOT  FOUND. 

•  I 

**  EACH  HAKE  UP  EVENT  IS  GIVEN  A  UNIQUE  NAME  FOR  EASE  OF  RESCHEDULING 

SCHEDULE  A  US. NODE. HAKE. UP  CALLED  THE. HAKE  GIVEN 

THIS. NODE,  MSG,  PAST. NODE.  HO.PCOUNT  AT  SETTING  (BUZZER) 


LET  BUZ. MAKE  (BUZZER)  -  THE. MAKE 
«  « 

FILE  BUZ. NODE  IN  BUZ. LI  ST (BUZZER) 

FILE  BUZZER  IN  ALARH. CLOCK (THIS. NODE) 
«  « 

GO  CHECK. THE . QUEUES 


•HARM.  MSG* 


"  DETERMINE  IF  THIS  IS  A  GROUP  OR  FAMILT  WARNING  AND  TAKE  PROPER  ACTION. 

GO  TO  ERROR.  GRP. WARNING,  FAN. WARNING  PER  CLASS  (MSG) 

«  • 

’ERROR* 

”  INVALID  NOOE  WARNING  MESSAGE.  NO  ACTION  TAKEN. 

OESTROT  UPOATE  CALLEO  U.MSG 
GO  CHECK. THE. QUEUES 

«  « 


'GRP. WARNING’ 

«  « 

”  CHECK  IF  GROUP  IS  VALID. 

•  » 

IF  GROUP  (THIS.  NOOE)  NE  ORIGlN(MSG). 

OESTROT  UPOATE  CALLEO  U.MSG 
GO  CHECK. THE. QUEUES 

REGARDLESS 
«  « 

’*  KEEP  A  RECORO  OF  TRANSMISSIONS, 

CREATE  A  RECORO 

LET  REC.ORIGIN  (RECORO)  -  ORIGIN  (MSG) 

LET  REC, TIME  (RECORO)  •  BEGIN, TIME  (MSG) 

FILE  RECORO  IN  XMT. RECORO  (THIS. NODE) 

«  « 

”  LOCAL  NOOE  RECORDS  ARE  MAINTAINED. FOR  ONLY  A  SET  PERIOD  OF  TIME. 

%  %  t 

IF  INIT.BP  -  DEAD, 

SCHEOULE  A  Ufl. ERASE. RECORO  GIVEN  THIS. NOOE,  RECORO  IN  ERA. PERIOD  UNITS 

REGARDLESS 
«  « 

”  SCHEOULE  THE  RETRANSMISSION  OF  THE  WARNING  GROUP  UPDATE  TO 

”  ALL  NEIGHBOR  NOOES  WITHIN  THIS  GROUP. 

•  • 

FOR  EACH  LINK  IN  LINK. SET (THIS. NOOE)  WITH  GROUP  (THIS. NOOE)  ■ 

GROUP  (TERM  (LINK) )  ANO  TERM  (LINK)  NE  PAST.  NOOE.  DO 

«  « 

CREATE  AN  UPOATE 
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LET  BEGIN. TINE  (UPDATE)  -  BEGIN. TIME  (MSG) 

LET  CLASS  (UPDATE)  •  CLASS  (MSG) 

LET  ORIGIN (UPDATE)  -  ORIGIN  (MSG) 

LET  FM. NODE (UPDATE)  •  THIS. NODE 

LET  VABIETY  (UPDATE)  -  VAR1ETT  (MSG) 

LET  HOPCNT  (UPDATE)  •  HOPCNT  (HSG)  ♦  ) 

LET  TO. NODE  (UPDATE)  -  TERM  (LINK) 

LET  FIRING. TIME  (UPDATE)-  FIRING. TIHE  (MSG) 

•  « 

PERFORM  U2. TRANSMIT. UPDATE  GIVEN  UPDATE.  LINK 

LOOP 

t  • 

''  SCHEDULE  THE  TRANSMISSION  OF  A  REGULAR  GROUP  UPDATE  MESSAGE 

"  TO  ALL  NEIGHBOR  NODES  MH1CH  ARE  NOT  IN  THIS  NODE'S  GROUP. 

0  « 

IF  PRNT  >-  3, 

SKIP  1  LINE 

PRINT  2  LINES  WITH  TIME.V,  THI S. NODE.  GROUP  (THIS. NODE) , 

FIRING. TIHE  (MSG)  AS  FOLLOWS 

mmn.mmmm  (mm)  i  GROUP  UPDATE  MESSAGE  WARNING  ORIGINATED. 

GROUP (mm)  SET  TO  XMT  UPDATE  AT  mmm.mmmm. 

REGARDLESS 
•  « 

SCHEDULE  A  U7. UNIT. FIRING  GIVEN  THIS. NODE.  CLASS  (MSG).  ORIGIN  (MSG). 

BEGIN.  TIME  (MSG)  AT  FIRING. TIME  (HSG) 

DESTROT  UPDATE  CALLED  U.MSG 

GO  CHECK. THE. QUEUES 
«  « 

I  « 

'FAM. WARNING'  . 

I  t 

"  CHECK  IF  FAMILT  IS  VALID. 

I  • 

IF  FAMILY  (THIS. NODE)  NE  ORIGIN  (MSG) 

DESTROT  UPDATE  CALLED  U.MSG 
GO  CHECK. THE. QUEUES 

REGARDLESS 
•  « 

”  SCHEDULE  THE  RETRANSMISSION  OF  THE  WARNING  FAMILT  UPDATE  TO 

”  ALL  NEIGHBOR  NODES  WITHIN  THIS  FAMILT. 

*  « 

"  KEEP  A  RECORD  OF  TRANSMISSIONS. 

I  » 

CREATE  A  RECORD 

LET  REC. ORIGIN (RECORO)  -  ORIGIN  (HSG) 

LET  REC. TIME  (AECORD)  -  BEGIN.  TIHE  (MSG) 

FILE  RECORD  IN  XMT. RECORD  (THIS. NODE) 

0  • 

"  LOCAL  NODE  RECORDS  ARE  MAINTAINED  FOR  ONLY  A  SET  PERIOD  OF  TIME. 
«  « 
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IF  INIT.BP  -  DEAD, 

SCHEDULE  A  UB. ERASE. RECORD  GIVEN  THIS. NODE.  RECORD  IN  ERA. PERIOD  UNITS 

REGAROLESS 
«  • 

FOR  EACH  LINK  IN  LINK. SET  (THIS. NODE)  WITH  FAMILY  (THIS. NODE)  - 
FAMILY  (TERM  (LINK))  AND  TERM  (LINK)  NE  PAST.  NODE.  DO 

•  • 

CREATE  AN  UPDATE 

LET  BEGIN. TIME  (UPDATE)  -  BEGIN. TIME  (MSG) 

LET  CLASS  (UPDATE)  -  CLASS  (MSG) 

LET  ORIGIN (UPDATE)  -  ORIGIN (MSG) 

LET  FM. NODE (UPDATE)  -  THIS. NODE 

LET  VARIETT  (UPDATE)  -  VARIETY  (MSG) 

LET  HOPCNT  (UPDATE)  -  HOPCNT  (MSG)  ♦  1 
LET  TO. NODE  (UPDATE)  -  TERM  (LINK) 

LET  FIRING. TIME  (UPDATE)-  FIRING. TIME  (MSG) 

•  • 

PERFORM  U2. TRANSMIT. UPDATE  GIVEN  UPDATE.  LINK 

LOOP 
«  « 

••  SCHEDULE  THE  TRANSMISSION  OF  A  REGULAR  FRHILT  UPDATE  MESSAGE 

'*  TO  ALL  NEIGHBOR  NODES  WHICH  ARE  NOT  IN  THIS  NODE'S  FAMILY. 

•  « 

IF  PANT  >-  3. 

SKIP  1  LINE 

PRINT  2  LINES  WITH  TIME.V.  THIS. NODE.  FAMILY  (THIS. NOOE) . 

FIRING. TIME  (MSG)  AS  FOLLOWS 

mmm.mmmm  (mm]  i  FAMILY  UPDATE  MESSAGE  WARNING  ORIGINATED. 

FAMILY  («mJ  SET  TO  XHT  UPDATE  AT  -mm.mmmm. 

REGAROLESS 
•  • 

SCHEDULE  A  U7. UNIT. FIRING  GIVEN  THIS. NODE.  CLASS (MSG) .  ORIGIN (MSG). 
BEGIN.T1ME  (MSG)  AT  FIRING. TIME  (MSG) 

DESTROY  UPDATE  CALLED  U.MSG 
•  « 

■CHECK. THE. QUEUES' 

•  % 

FOR  EACH  LINK  IN  LINK.  SET  (PAST. NODE)  WITH  TERM  (LINK)  -  THIS. NOOE. 

FIND  THE. LINK  ■  LINK. 

IF  FOUND, 

•  * 

*•  FIRST  CHECK  TO  SEE  IF  THERE  IS  ADDITIONAL  UPDATE  TRAFFIC  WAITING 

"  TO  BE  SENT. 

•  • 

IF  UGUEUE (THE. LINK)  IS  NOT  EMPTY, 

REMOVE  FIRST  0. UP. MSG  FROM  UQUEUE (THE. LINK) 

FILE  Q.UP.HSG  IN  UPROP. QUEUE (THE. LINK) 

SCHEOULE  AN  U4. RECEIVE. UPDATE  GIVEN  Q.UP.HSG  IN  U.XHN.TIHE  UNITS 

•  « 

IF  PROP. QUEUE (THE. LINK)  IS  NOT  EMPTY, 
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*•  THEN  THE  UPDATE  WHICH  JUST  ARRI VEO  WAS  INSERTED  INTO 

*•  THE  BIT  STREAM  OF  A  MESSAGE  PACKET  IN  TRANSIT.  THEREFORE 

**  THE  NEXT  UPDATE  TO  BE  SENT  HILL  ALSO  BE  INSERTED. 

«  % 

PERFORM  U3. INSERT. UPDATE  GIVEN  THE. LINK 
REGARDLESS 

ELSE 

•  % 

"  THE  UPOATE  QUEUE  IS  EHPTT  SO  HE  HILL  CHECK  FOR  MESSAGE  PACKET 

**  TRAFFIC  WAITING  TO  BE  SENT. 

•  « 

IF  PROP.  QUEUE  (THE. LINK)  IS  NOT  EMPTY, 

•  * 

**  THERE  IS  CURRENTLY  MESSAGE  TRAFFIC  BEING  SENT  OVER  THIS 

*•  LINK  ANO  NO  FURTHER  ACTION  IS  NECESSARY. 

RETURN 

REGARDLESS 

•  % 

"  THERE  IS  NO  TRAFFIC  IN  PROGRESS  SO  HE  HILL  CHECK  THE  MESSAGE 

••  QUEUE  TO  SEE  IF  TRAFFIC  IS  WAITING  TO  BE  SENT. 

IF  QUEUE  (THE. LINK)  IS  NOT  EMPTY, 

REMOVE  FIRST  PAC.KET  FROM  QUEUE (THE. LINK) 

LET  QUESIZ  (THE.  LINK)  >  N. QUEUE  (THE. LINK) 

SCHEDULE  A  M2. RECEIVE. MESSAGE. PACKET  CALLED 

THE. NAME  GIVEN  PAC.KET  AT  TIME.V  ♦  PKT.XMN.TIHE 
LET  P. ARRIVAL  (PAC.KET)  -  TIME.V  ♦  PKT . XMN.TIME 
LET  P. NAME  (PAC.KET)  -  THE. NAME 
FILE  PAC.KET  IN  PROP. QUEUE  (THE. LINK) 

RETURN 

REGARDLESS 

1  « 

•*  BOTH  QUEUES  ARE  EMPTY  AND  NO  MESSAGES  ARE  IN  TRANSIT. 

LET  STATUS  (THE. LINK)  -  IDLE 
REGAROLESS 
REGAROLESS 

RETURN 
#  « 

ENO  ’ ’OF  UN. RECEIVE. UPDATE 


EVENT  US. LINK. HEIGHT. CALCULATION 
•  • 

••  THIS  EVENT  DETERMINES  THE  POSITIVE  HEIGHT  ASSIGNEO  TO  EVERT  LINK 
•’  FROM  WHICH  THE  TEN  ALGORITHM  DETERMINES  THE  BEST  PATH  ROUTING 
**  BETWEEN  MOOES.  FIVE  METHODS  ARE  DETERMINED  IN  THIS  ROUTINE  AND 
**  THE  USER  SPECIFIES  WHICH  IS  ACTUALLY  UTILIZED  DURING  THE 

M  SIMULATION. 

•  « 

DEFINE  NUM,  HE  I . GMT  AS  INTEGER  VARIABLES 
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DEFINE  WT.AV6  AS  REAL  VARIABLES 
•  • 

LET  NUN  -  NUN. OF. HEIGHTS 
•  • 

IF  MANNER. OF. WEIGHTING  -  Br.QS12E.N0H. 

•  « 

"  THIS  METHOO  INVOLVES  USING  THE  INSTANTANEOUS  QUEUE  LENGTHS  FOR 
*'  F1NOING  THE  LINK  HEIGHT.  THIS  HETHOO  HAKES  NO  FURTHER  USE 
•*  Of  THIS  ROUTINE. 

GO  NO. NONE 

REGARDLESS 
•  « 

FOR  EACH  NODE.  DO 

FOR  EACH  LINK  IN  LINK. SET  INODE) .  00 

•  « 

CREATE  A  HEIGHT 

•  « 

GO  TO  NO. HARE.  USE. PAST. QSIZE,  USE.PAST.QAVG, 

USE. RHO. HEIGHT.  USE. RHfl. HEIGHT  PER  MANNER. OF. WEIGHTING 

•  « 

'USE. PAST. QSIZE* 

•  « 

*•  THIS  METHOD  OF  WEIGHTING  IS  BASED  UPON  TAKING  THE  AVERAGE  OF 

*•  'N*  QUEUE  SAMPLES  TAKEN  DURING  A  “WINDOW*  OF  FIXED  LENGTH. 

•*  THIS  HINOOH  'SLIDES'  ALONG  IN  TIHE  SINCE  ONLT  THE  MOST  RECENT 

•'  SAMPLES  ARE  USED  IN  DETERMINING  THE  AVERAGE. 

•  « 

LET  HT. SIZE (HEIGHT)  ■  N. QUEUE (LINK) 

GO  AROUNO. AGAIN 

«  • 

'USE.PAST.QAVG' 

•  •  • 

'•  THIS  METHOD  USES  THE  SAHE  SLIDING  WINDOW  TECHNIQUE  EXCEPT 

”  INSTEAD  OF  TAKING  A  ’SNAPSHOT'  SAHPLE  OF  THE  QUEUE  SIZE  AT 

"  REGULAR  TIHE  INTERVALS.  THIS  USES  THE  AVERAGE  QUEUE  SIZE  OVER 

’•  THE  TIME  INTERVAL. 

•  • 

LET  HT. SIZE  (HEIGHT)  »  AVG.  WEIGHT  (LINK) 

RESET  TOTALS  OF  QUESIZILINK) 

GO  AROUND. AGAIN 


'USE. RHO. HEIGHT’ 

THIS  METHOO  USES  A  COMBINATION  OF  WEIGHTING  FUNCTIONS;  ONE 
BASED  UPON  THE  LINK  UTILIZATION  FACTOR  DURING  THE  PAST  TIHE 
UIMOOH  ANO  THE  SECOND  A  LEAST  HOPS  STSTEH.  WHEN  THE  LINK 
UTILIZATION  FACTOR  IS  LESS  THEN  .5  THE  BEST  PATHS  WILL  BE 
DETERMINED  PRIHARILT  BT  A  LEAST  HOPS  SCHEME.  HOWEVER  IF  THE 
UTILIZATION  FACTOR  IS  GREATER  THAN  .5  THE  LINK  HEIGHT  WILL  BE 
PREDOMINANTLT  A  FUNCTION  OF  THAT  FACTOR. 
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A  SECOND  METHOD  (8T. COMBINE)  MfiKES  USE  OF  THIS  TERM  BUT  IN 
ADDITION  IT  ALSO  USES  THE  SIZE  OF  THE  QUEUE.  IN  THIS 
METHOD  BOTH  THE  AVERAGE  LINK  USAGE  CTHE  RHO  TERM)  AND  THE 
CURRENT  TRANSIENT  BEHAVIOR  OF  THE  LINK  (THE  QUEUE  SIZE  TERM) 
ARE  TAKEN  INTO  CONSIDERATION. 


IF  RHO  (LINK)  >  .95. 

LET  NT. SIZE  (WEIGHT)  *  20.0 

GO  SOME. MORE 
REGAROLESS 

LET  HT.  SIZE  (WEIGHT)  -  1.  ♦  (RHO  (LINK)  /  (1 .  -  RHO  (LINK))) 
•SOME. MORE* 

RESET  TOTALS  OF  N. PROF. QUEUE  (LINK) 


•AROUND. AGAIN' 


ONLY  THE  PAST  *NUH’  OF  SAMPLES  ARE  CONSIDERED. 
IF  N. SET. OF. HEIGHTS (LINK)  >-  NUM. 


REMOVE  THE  FIRST  MEI.GHT  FROM  SET. OF. HEIGHTS (LINK) 
DESTROY  HEIGHT  CALLED  MEI.GHT 
REGARDLESS 


FILE  HEIGHT  IN  SET. OF. HEIGHTS (LINK) 


FOR  EACH  HEIGHT  IN  SET. OF. HEIGHTS (LINK) .  COMPUTE  HT. AVG 
AS  THE  MEAN  OF  HT. SIZE  (HEIGHT) 

LET  LK. HEIGHT  (LINK)  -  HT. AVG 


SCHEDULE  A  US. LINK. HEIGHT .CALCULATION  IN  UT.TIHE  UNITS 


'NO.HORE ' 

RETURN 

ENO  * *0F  US. LINK. HEIGHT. CALCULATION 


EVENT  U6. NODE. HAKE. UP  GIVEN  HK. NODE.  HK.HSG.  BPATH,  HOPNUM 


••  THIS  EVENT  SCHEDULES  THE  TRANSMISSION  OF  AN  UPDATE  AT  THE  MOHENT 
••  THE  NODE'S  ALARM  CLOCK  GOES  OFF  FOR  THAT  UPDATE  MESSAGE. 


DEFINE  THIS. NODE.  HSG,  BESTPATH.  HOP.NUH.  THE. BUZZ,  FLAG 
AS  VARIABLES 

DEFINE  NEH.TIHE  AS  A  REAL  VARIABLE 


LET  THIS. NODE  -  HK.NODE 
LET  HSG  -  HK.HSG 
LET  BESTPATH  -  BPATH 
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